-- Logs begin at Mon 2022-07-18 09:42:29 UTC, end at Mon 2022-07-18 10:45:44 UTC. -- Jul 18 10:19:56.026637 dv-cinder-837546-3-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 18 10:19:56.035218 dv-cinder-837546-3-iscsi devstack@n-api.service[103149]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 18 10:19:56.037205 dv-cinder-837546-3-iscsi devstack@n-api.service[103149]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Jul 18 10:19:56 2022] *** Jul 18 10:19:56.037205 dv-cinder-837546-3-iscsi devstack@n-api.service[103149]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 18 10:19:56.037205 dv-cinder-837546-3-iscsi devstack@n-api.service[103149]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 18 10:19:56.037205 dv-cinder-837546-3-iscsi devstack@n-api.service[103149]: nodename: dv-cinder-837546-3-iscsi Jul 18 10:19:56.037205 dv-cinder-837546-3-iscsi devstack@n-api.service[103149]: machine: x86_64 Jul 18 10:19:56.037205 dv-cinder-837546-3-iscsi devstack@n-api.service[103149]: clock source: unix Jul 18 10:19:56.037205 dv-cinder-837546-3-iscsi devstack@n-api.service[103149]: pcre jit disabled Jul 18 10:19:56.037205 dv-cinder-837546-3-iscsi devstack@n-api.service[103149]: detected number of CPU cores: 4 Jul 18 10:19:56.037205 dv-cinder-837546-3-iscsi devstack@n-api.service[103149]: current working directory: / Jul 18 10:19:56.037205 dv-cinder-837546-3-iscsi devstack@n-api.service[103149]: detected binary path: /usr/bin/uwsgi-core Jul 18 10:19:56.037917 dv-cinder-837546-3-iscsi devstack@n-api.service[103149]: your processes number limit is 47680 Jul 18 10:19:56.037917 dv-cinder-837546-3-iscsi devstack@n-api.service[103149]: your memory page size is 4096 bytes Jul 18 10:19:56.037917 dv-cinder-837546-3-iscsi devstack@n-api.service[103149]: detected max file descriptor number: 2048 Jul 18 10:19:56.037917 dv-cinder-837546-3-iscsi devstack@n-api.service[103149]: lock engine: pthread robust mutexes Jul 18 10:19:56.037917 dv-cinder-837546-3-iscsi devstack@n-api.service[103149]: thunder lock: enabled Jul 18 10:19:56.037917 dv-cinder-837546-3-iscsi devstack@n-api.service[103149]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 18 10:19:56.037917 dv-cinder-837546-3-iscsi devstack@n-api.service[103149]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 18 10:19:56.076758 dv-cinder-837546-3-iscsi devstack@n-api.service[103149]: Python main interpreter initialized at 0x55f09e13a9c0 Jul 18 10:19:56.076758 dv-cinder-837546-3-iscsi devstack@n-api.service[103149]: python threads support enabled Jul 18 10:19:56.076758 dv-cinder-837546-3-iscsi devstack@n-api.service[103149]: your server socket listen backlog is limited to 100 connections Jul 18 10:19:56.076758 dv-cinder-837546-3-iscsi devstack@n-api.service[103149]: your mercy for graceful operations on workers is 90 seconds Jul 18 10:19:56.077094 dv-cinder-837546-3-iscsi devstack@n-api.service[103149]: mapped 403077 bytes (393 KB) for 2 cores Jul 18 10:19:56.077178 dv-cinder-837546-3-iscsi devstack@n-api.service[103149]: *** Operational MODE: preforking *** Jul 18 10:19:56.077412 dv-cinder-837546-3-iscsi devstack@n-api.service[103149]: *** uWSGI is running in multiple interpreter mode *** Jul 18 10:19:56.077412 dv-cinder-837546-3-iscsi devstack@n-api.service[103149]: spawned uWSGI master process (pid: 103149) Jul 18 10:19:56.077588 dv-cinder-837546-3-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 18 10:19:56.078649 dv-cinder-837546-3-iscsi devstack@n-api.service[103149]: spawned uWSGI worker 1 (pid: 103150, cores: 1) Jul 18 10:19:56.078649 dv-cinder-837546-3-iscsi devstack@n-api.service[103149]: spawned uWSGI worker 2 (pid: 103151, cores: 1) Jul 18 10:19:56.078649 dv-cinder-837546-3-iscsi devstack@n-api.service[103149]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 18 10:19:56.735052 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 18 10:19:56.745776 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 18 10:19:57.829934 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 18 10:19:57.829934 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: from cryptography.utils import int_from_bytes Jul 18 10:19:57.830533 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 18 10:19:57.830533 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: from cryptography.utils import int_from_bytes Jul 18 10:19:57.832748 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 18 10:19:57.832748 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: from cryptography.utils import int_from_bytes Jul 18 10:19:57.833172 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 18 10:19:57.833172 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: from cryptography.utils import int_from_bytes Jul 18 10:20:00.289069 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 18 10:20:00.289615 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 18 10:20:00.289819 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 18 10:20:00.290170 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 18 10:20:00.290423 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 18 10:20:00.290806 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:20:00.291130 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:20:00.291447 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:20:00.291552 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 18 10:20:00.291925 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:20:00.292017 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 18 10:20:00.292111 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:20:00.292294 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 18 10:20:00.292384 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:20:00.292679 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 18 10:20:00.292773 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:20:00.292938 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 18 10:20:00.293042 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:20:00.293316 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:20:00.293421 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:20:00.293577 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:20:00.293681 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:20:00.293889 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:20:00.293990 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:20:00.294212 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-837546-3-iscsi {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:20:00.294301 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:20:00.294532 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:20:00.294621 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:20:00.294839 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:20:00.294937 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:20:00.295148 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:20:00.295237 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:20:00.295463 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:20:00.295559 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:20:00.295763 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:20:00.295850 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:20:00.296037 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:20:00.296139 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:20:00.296349 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:20:00.296445 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:20:00.296694 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-837546-3-iscsi {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:20:00.296880 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:20:00.297293 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:20:00.297442 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:20:00.297559 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:20:00.297677 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:20:00.297794 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:20:00.297911 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:20:00.298060 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:20:00.298222 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:20:00.298389 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:20:00.298536 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:20:00.298712 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:20:00.298852 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:20:00.299018 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:20:00.299170 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:20:00.299504 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:20:00.299642 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:20:00.299830 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:20:00.299920 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:20:00.300139 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:20:00.300237 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:20:00.300453 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:20:00.300564 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-837546-3-iscsi {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:20:00.300811 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:20:00.300910 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:20:00.301125 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:20:00.301223 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:20:00.301433 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:20:00.301527 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:20:00.301753 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:20:00.301897 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:20:00.302061 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:20:00.302148 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:20:00.302381 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:20:00.302470 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:20:00.302689 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:20:00.302789 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:20:00.303069 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:20:00.303185 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-837546-3-iscsi {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:20:00.303381 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:20:00.303471 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:20:00.303691 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:20:00.303777 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:20:00.304004 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:20:00.304103 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:20:00.304320 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:20:00.304407 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:20:00.304673 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:20:00.304779 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:20:00.304979 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:20:00.305078 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:20:00.305289 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:20:00.305377 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:20:00.305599 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:20:00.305688 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:20:00.305915 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:20:00.306006 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:20:00.306222 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:20:00.306311 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:20:00.306527 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:20:00.306623 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:20:00.306778 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:20:00.306867 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:20:00.307086 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:20:00.307175 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:20:00.307409 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:20:00.307498 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:20:00.307727 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:20:00.307816 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:20:00.308046 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:20:00.308139 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:20:00.308298 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:20:00.308396 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:20:00.308579 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:20:00.308682 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:20:00.308906 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:20:00.309001 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:20:00.309204 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:20:00.309309 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:20:00.309510 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:20:00.309600 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:20:00.309813 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:20:00.309900 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:20:00.310119 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:20:00.310223 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:20:00.310425 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:20:00.310523 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:20:00.310676 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:20:00.310770 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:20:00.310927 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:20:00.311017 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:20:00.311247 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:20:00.311339 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:20:00.311570 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:20:00.311701 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:20:00.311873 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:20:00.312005 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:20:00.312179 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:20:00.312269 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:20:00.312484 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:20:00.312608 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:20:00.312812 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:20:00.312900 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:20:00.313124 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:20:00.313221 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:20:00.313429 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:20:00.313528 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.33 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:20:00.313737 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:20:00.313824 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.33 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:20:00.314038 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:20:00.314133 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:20:00.314355 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:20:00.314450 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:20:00.314668 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:20:00.314756 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:20:00.314975 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:20:00.315071 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:20:00.315309 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:20:00.315405 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:20:00.315628 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:20:00.315715 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:20:00.315936 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:20:00.316026 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.33 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:20:00.316245 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:20:00.316334 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.33 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:20:00.316571 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:20:00.316662 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:20:00.316891 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:20:00.317026 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:20:00.317216 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:20:00.317312 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:20:00.317519 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:20:00.317606 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:20:00.317769 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:20:00.317857 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:20:00.318071 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:20:00.318161 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:20:00.318375 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:20:00.318473 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:20:00.318698 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:20:00.318794 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:20:00.319003 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:20:00.319092 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:20:00.319310 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:20:00.319406 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:20:00.319617 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:20:00.319719 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:20:00.319917 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:20:00.320017 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:20:00.320165 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:20:00.320252 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:20:00.320467 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:20:00.320651 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:20:00.320797 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:20:00.320885 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:20:00.321115 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:20:00.321245 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:20:00.321420 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:20:00.321515 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:20:00.321723 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:20:00.321810 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:20:00.322025 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:20:00.322118 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:20:00.322322 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:20:00.322424 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:20:00.322623 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:20:00.322724 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:20:00.322928 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:20:00.323015 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:20:00.323233 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:20:00.323321 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:20:00.323535 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:20:00.323621 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:20:00.323839 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:20:00.323934 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:20:00.324140 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:20:00.324228 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:20:00.324443 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:20:00.324620 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:20:00.324771 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:20:00.324861 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:20:00.325076 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:20:00.325173 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:20:00.325376 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:20:00.325462 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:20:00.325695 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:20:00.325782 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:20:00.325998 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:20:00.326087 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:20:00.326302 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:20:00.326387 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:20:00.326602 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:20:00.326697 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:20:00.326907 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:20:00.327007 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:20:00.327211 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:20:00.327354 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:20:00.327514 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:20:00.327648 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:20:00.327813 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:20:00.327901 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:20:00.328119 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:20:00.328208 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:20:00.328420 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:20:00.328548 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:20:00.328749 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:20:00.328840 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:20:00.329053 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:20:00.329140 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:20:00.329355 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:20:00.329442 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:20:00.329655 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:20:00.329743 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:20:00.329961 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:20:00.330048 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:20:00.330255 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:20:00.330349 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:20:00.330553 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:20:00.330640 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:20:00.331387 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:20:00.331481 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:20:00.331693 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:20:00.331791 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:20:00.331997 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:20:00.332093 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:20:00.332299 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:20:00.332387 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:20:00.332632 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:20:00.332740 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:20:00.332943 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:20:00.333032 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:20:00.333247 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:20:00.333342 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:20:00.333549 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:20:00.333645 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:20:00.333853 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:20:00.333979 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.334152 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:20:00.334240 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.334469 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:20:00.334566 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.334787 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:20:00.334886 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.335096 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:20:00.335192 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.335403 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:20:00.335494 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.335709 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:20:00.335796 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.336027 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:20:00.336116 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.336351 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.336439 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.336704 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.336793 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.337047 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.337134 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.337362 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.337459 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.337693 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.337782 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.338010 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.338110 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.338328 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.338415 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.338639 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.338734 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.338951 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.339047 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.339279 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.339367 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.339595 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.339703 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.339907 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.340005 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.340220 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.340315 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.340557 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.340650 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.340881 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.340985 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.341194 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.341290 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.341510 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.341596 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.341827 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.342077 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.342168 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.342444 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.342640 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.342759 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.343089 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.343221 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.343410 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.343721 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.343809 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.344061 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.345460 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.345561 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.345645 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.345740 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.345740 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.345897 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.345988 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.346077 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.346077 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.346234 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.346345 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.347061 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.347170 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.347384 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.347713 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.347865 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.348025 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.348814 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.348919 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.349005 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.349087 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.349167 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.349247 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.349344 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.349431 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.349560 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.349649 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.349871 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.349960 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.350206 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.350296 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.350521 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.350617 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.350835 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.350923 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.353114 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.353209 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.353292 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.353372 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.353458 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.353540 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.353628 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.353710 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.353789 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.353869 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.353948 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.354029 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.354182 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.354326 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.354469 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.354469 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.354738 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.354897 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.355047 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.355188 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.355336 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.355479 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.355694 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.355860 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.356006 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.356151 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.356572 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.356719 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.356858 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.357028 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.357172 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.357317 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.357436 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.357592 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.357680 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.357770 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.357852 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.357920 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.357985 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.358064 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.358162 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.358286 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.358403 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.358712 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.358834 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.359016 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.359341 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.359438 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.359647 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.359842 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.360033 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.360238 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.360356 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.360691 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.360845 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.361003 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.361160 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.361316 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.361469 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.361629 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.361789 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.361976 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.362139 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.362289 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.362455 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.362600 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.362771 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.362933 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.363087 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.363269 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.363412 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.363572 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.363728 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.363895 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.364041 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.364219 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.364375 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.364558 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.364735 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.364865 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.365044 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.365176 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.365371 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.365481 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.365696 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.365785 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.366013 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.366103 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.366319 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.366408 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.366632 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.366727 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.366936 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.367026 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.367239 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.367325 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.367540 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.367683 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.367843 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.367933 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.368143 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.368290 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.368449 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.368616 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.368778 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.368916 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.369055 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.369190 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.369353 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.369498 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.369677 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.369814 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.369986 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.370123 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.370287 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.370437 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.370574 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.370719 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.370879 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.371018 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.371220 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.371367 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.371525 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.371662 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.371865 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.372002 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.372172 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.372317 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.372489 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.372655 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.372825 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.372963 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.373139 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.373284 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.373458 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.373596 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.373766 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.373902 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.374161 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.374310 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.374446 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.374542 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.374671 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.374770 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.374992 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.375082 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.375303 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.375391 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.375604 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.375691 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.375918 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.376007 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.376241 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.376339 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.376575 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.376683 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.376900 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.376998 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.377205 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.377294 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.377511 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.378111 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.378360 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.378499 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.378670 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.378808 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.378982 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.379134 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.379281 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.379424 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.379591 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.379729 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.379905 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.380049 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.380212 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.380348 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.380534 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.380671 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.380848 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.380995 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.381157 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.381311 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.381467 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.381605 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.381773 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.381870 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.382076 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.382213 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.382385 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.382523 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.382706 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.382845 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.383013 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.383151 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.383331 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.383470 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.383637 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.383782 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.383963 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.384098 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.384257 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.384408 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.384579 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.384714 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.384889 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.385027 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.385194 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.385343 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.385500 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.385637 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.385795 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.385928 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.386111 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.386257 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.386421 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.386558 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.386727 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.386866 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.387028 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.387182 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.387318 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.387455 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.387632 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.387771 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.387932 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.388076 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.388221 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.388361 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.388545 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.388638 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.388867 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.388967 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.389173 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.389260 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.389474 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.389576 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.389788 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.389934 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.390093 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.390193 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.390396 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.390495 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.390703 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.390806 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.391010 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.391115 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.391312 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.391410 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.391615 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.391712 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.391928 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.392022 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.392235 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.392332 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.392564 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.392658 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.392870 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.392959 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.393228 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.393337 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.394038 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.394130 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.394371 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.394457 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.394684 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.394795 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.394990 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.395086 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.395295 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.395382 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.395615 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.395717 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.395925 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.396011 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.396234 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.396322 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.396562 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.396666 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.396876 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.396971 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.397186 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.397281 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.397495 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.397583 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.397806 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.397896 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.398111 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.398204 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.398444 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.398532 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.398712 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.398802 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.399011 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.399098 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.399321 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.399413 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.399631 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.399727 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.399941 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.400200 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.400298 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.400555 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.400658 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.400870 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.400966 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.401188 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.401275 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.401511 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.401752 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.401848 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.402086 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.402183 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.402403 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.402494 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.402724 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.402812 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.403043 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.403143 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.403362 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.403452 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.403669 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.403755 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.403973 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.404068 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.404285 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.404382 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.404667 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.404775 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.404926 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.405027 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.405228 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.405325 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.405529 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.405616 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.405829 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.405925 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.406133 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.406234 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.406437 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.406524 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.406737 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.406824 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.407045 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.407143 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.407342 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.407436 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.407644 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.407732 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.407941 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.408028 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.408241 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.408335 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.408593 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.408696 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.408895 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.408983 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.409198 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.409292 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.409497 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.409594 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.409824 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.409914 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.410126 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.410213 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.410425 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.410511 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.410729 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.410819 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.411031 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.411127 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.411369 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.411466 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.411673 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.411761 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.411990 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.412078 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.412292 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.412388 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.412622 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.412715 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.412929 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.413017 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.413246 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.413358 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.413554 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.413651 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.413855 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.413940 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.414159 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.414248 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.414462 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.414557 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.414766 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.414856 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.415071 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.415159 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.415368 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.415453 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.415672 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.415757 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.415970 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.416057 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.416275 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.416362 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.416605 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.416704 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.416906 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.416994 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.417204 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.417290 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.417502 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.417596 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.417805 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.417891 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.418106 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.418193 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.418405 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.418523 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.418706 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.418812 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.419009 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.419103 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.419308 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.419403 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.419610 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.419699 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.419911 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.419998 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.420207 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.420303 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.420546 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.420638 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.420834 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.420934 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.421132 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.421219 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.421434 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.421524 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.421734 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.421820 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.422037 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.422124 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.422336 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.422425 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.422638 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.422731 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.422941 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.423030 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.423238 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.423324 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.423538 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.423627 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.423845 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.423935 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.424147 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.424243 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.424471 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.424641 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.424808 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.424941 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.425110 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.425197 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.425413 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.425511 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.425717 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.425815 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.426016 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.426103 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.426315 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.426414 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.426616 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.426703 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.426917 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.427003 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.427217 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.427383 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.427516 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.427610 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.427819 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.427915 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.428120 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.428208 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.428417 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.428537 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.428746 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.428866 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.429064 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.429164 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.429373 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.429480 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.429683 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.429791 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.429989 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.430088 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.430290 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.430387 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.430622 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.430718 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.430922 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.431018 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.431232 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.431328 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.431546 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.431643 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.431852 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.431950 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.432166 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.432263 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.432471 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.432596 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.432805 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.432902 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.433109 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.433212 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.433411 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.433521 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.433726 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.433822 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.434031 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.434127 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.434340 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.434444 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.434644 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.434748 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.434946 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.435050 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.435262 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.435360 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.435566 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.435655 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.435871 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.435957 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.436175 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.436262 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.436485 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.436639 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.436813 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.436901 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.437116 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.437211 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.437420 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.437506 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.437725 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.437818 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.438033 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.438131 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.438334 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.438420 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.438642 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.438735 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.438948 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.439052 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.439257 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.439366 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.439564 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.439668 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.439867 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.439971 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.440809 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.440899 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.441004 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.441110 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.441314 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.441402 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.441620 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.441707 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.441921 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.442023 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.442231 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.442319 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.442536 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.442623 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.442837 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.442965 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.443148 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.443282 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.443453 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.443593 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.443761 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.443895 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.444065 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.444203 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.444494 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.444625 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.444832 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.444930 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.445145 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.445250 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.445446 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.445533 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.445757 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.445847 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.446068 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.446156 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.446381 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.446478 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.446695 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.446794 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.446998 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.447088 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.447318 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.447413 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.447626 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.447715 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.447947 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.448035 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.448249 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.448346 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.448574 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.448666 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.448884 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.449068 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.449205 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.449350 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.449487 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.449631 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.449796 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.449932 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.450101 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.450247 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.450404 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.450544 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.450723 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.450862 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.451010 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.451183 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.451328 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.451495 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.451729 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.451867 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.452041 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.452179 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.452389 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.452585 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.452740 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.452873 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.453022 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.453158 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.453343 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.453481 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.453653 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.453795 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.453975 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.454126 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.454296 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.454435 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.454606 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.454744 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.454919 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.455058 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.455206 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.455341 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.455527 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.455735 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.456367 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.456526 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.456710 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.456847 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.457023 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.457161 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.457328 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.457475 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.457652 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.457792 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.457976 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.458165 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.458318 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.458465 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.458595 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.458685 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.458939 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.459068 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.459247 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.459376 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.459554 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.459652 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.459857 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.459947 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.460164 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.460255 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.460486 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.460632 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.460810 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.460899 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.461138 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.461424 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.461523 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.461727 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.461818 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.462033 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.462130 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.462340 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.462428 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.462644 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.462746 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.462954 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.463083 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.463259 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.463351 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.463564 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.463654 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.463868 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.463966 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.464186 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.464281 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.464486 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.464658 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.464827 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.464916 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.465136 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.465224 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.465445 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.465535 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.465748 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.465838 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.466049 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.466137 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.466347 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.466435 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.466662 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.466751 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.466966 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.467055 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.467269 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.467418 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.467574 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.467730 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.467958 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.468061 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.468223 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.468323 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.468566 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.468660 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.468895 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.468982 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.469215 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.469360 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.469527 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.469623 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.469848 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.469936 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.470153 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.470252 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.470458 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.470549 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.470769 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.470857 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.471074 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.471182 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.471397 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.471491 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.471702 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.471789 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.472008 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.472096 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.472306 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.472392 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.472631 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.472724 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.472936 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.473070 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.473244 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.473333 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.473545 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.473634 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.473847 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.473944 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.474147 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.474235 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.474446 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.474620 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.474750 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.474838 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.475049 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.475135 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.475433 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.475547 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.475664 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.475755 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.475966 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.476057 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.476267 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.476365 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.476621 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.476714 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.476925 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.477013 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.477243 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.477344 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.477555 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.477644 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.477872 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.477969 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.478187 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.478276 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.478489 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.478585 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.478803 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.478889 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.479113 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.479201 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.479425 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.479515 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.479736 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.479822 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.480046 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.480135 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.480356 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.480442 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.480695 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.480785 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.481007 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.481103 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.481569 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.481776 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.481886 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.482109 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.482201 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.482427 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.482515 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.482743 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.483001 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.483102 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.483328 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.483416 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.483663 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.483749 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.483979 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.484085 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.484293 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.484439 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.484627 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.484884 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.484975 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.485256 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.485417 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.485586 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.485907 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.486014 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.486241 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.486411 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.486558 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.486868 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.487027 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.487206 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.487352 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.487522 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.487747 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.487882 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.488075 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.488220 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.488406 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.488602 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.488840 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.488939 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.489154 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.489251 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.489470 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.489567 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.489784 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.489879 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.490093 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.490201 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.490408 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.490505 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.490723 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.490818 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.491034 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.491125 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.491345 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.491434 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.491659 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.491749 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.491971 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.492060 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.492284 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.492373 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.492622 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.492730 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.492943 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.493030 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.493254 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.493350 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.493565 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.493662 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.493874 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.493969 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.494187 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.494387 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.494485 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.494704 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.494795 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.495038 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.495127 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.495363 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.495461 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.495691 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.495812 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.496009 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.496108 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.496328 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.496435 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.496678 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.496873 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.497031 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.497199 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.497343 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.497536 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.497640 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.497864 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.497970 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.498170 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.498261 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.498492 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.498582 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.498803 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.498893 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.499107 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.499205 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.499429 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.499583 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.499741 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.499899 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.500042 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.500270 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.500419 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.500642 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.500789 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.500959 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.501110 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.501255 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.501390 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.501564 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.501703 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.501887 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.502032 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.502178 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.502312 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.502498 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.503237 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.503383 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.503590 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.503745 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.503909 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.504048 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.504219 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.504356 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.504541 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.504636 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.504850 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.504952 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.505163 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.505254 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.505472 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.505562 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.505779 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.505929 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.506069 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.506206 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.506380 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.506519 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.506688 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.506826 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.506994 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.507147 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.507285 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.507422 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.507568 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.507704 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.507879 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.508027 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.508204 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.508339 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.508478 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.508581 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.508795 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.508901 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.509099 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.509188 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.509411 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.509500 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.509712 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.509823 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.510020 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.510120 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.510321 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.510410 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.510622 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.510718 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.510923 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.511010 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.511224 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.511311 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.511528 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.511619 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.511840 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.511929 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.512147 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.512236 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.512458 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.512582 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.512790 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.512879 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.513102 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.513191 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.513408 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.513498 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.513719 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.513807 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.514030 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.514128 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.514375 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.514463 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.514684 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.514775 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.514990 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.515214 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.515304 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.515549 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.515638 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.515871 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.516015 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.516203 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.516302 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.516538 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.516630 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.516851 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.516939 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.517159 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.517250 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.517464 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.517700 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.517789 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.518034 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.518125 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.518895 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.519004 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.519231 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.519321 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.519544 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.519633 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.519858 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.519960 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.520166 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.520274 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.520472 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.520581 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.520804 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.520891 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.521116 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.521223 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.521429 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.521517 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.521737 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.521824 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.522046 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.522147 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.522351 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.522448 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.522659 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.522747 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.522969 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.523068 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.523280 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.523369 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.523591 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.523681 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.523900 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.523990 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.524211 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.524300 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.524539 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.524682 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.524842 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.525044 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.525161 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.525481 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.525603 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.525801 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.526119 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.526235 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.526436 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.526727 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.526842 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.527047 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.527200 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.527357 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.527524 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.527666 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.527836 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.527977 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.528257 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.528343 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.528596 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.528690 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.528924 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.529026 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.529233 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.529321 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.529548 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.529635 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.529872 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.529976 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.530201 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.530321 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.530510 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.530614 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.530834 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.530938 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.531148 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.531245 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.531463 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.531561 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.531773 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.531918 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.532093 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.532232 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.532404 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.532569 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.532715 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.532858 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.533029 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.533168 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.533335 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.533482 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.533646 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.533784 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.534000 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.534139 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.534303 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.534448 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.534604 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.534746 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.534892 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.535028 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.535188 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.535334 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.535493 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.535632 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.535776 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.535917 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.536061 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.536204 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.536371 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.536549 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.536687 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.536822 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.536990 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.537156 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.537292 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.537376 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.537577 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.537667 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.537875 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.537964 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.538175 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.538262 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.538477 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.538577 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.538778 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.538867 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.539078 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.539165 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.539384 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.539473 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.539683 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.539772 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.539987 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.540137 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.540310 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.540457 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.540595 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.540681 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.540890 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.540985 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.541193 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.541295 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.541493 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.541590 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.541822 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.541920 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.542152 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.542314 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.542462 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.542551 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.542781 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.542868 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.543091 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.543182 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.543401 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.543487 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.543707 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.543793 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.544026 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.544117 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.544333 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.544420 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.544669 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.544760 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.544980 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.545070 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.545285 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.545373 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.545594 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.545683 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.545902 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.545992 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.546206 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.546293 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.546516 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.546616 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.546826 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.546917 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.547137 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.547245 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.547450 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.547549 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.547769 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.547859 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.548071 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.548158 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.548382 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.548482 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.548726 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.548816 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.549040 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.549140 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.549349 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.549459 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.549681 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.549768 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.549987 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.550074 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.550297 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.550387 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.550603 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.550692 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.550909 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.550996 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.551215 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.551303 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.551522 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.551618 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.551832 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.551929 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.552137 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.552224 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.552449 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.552588 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.552808 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.552908 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.553124 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.553213 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.553446 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.553542 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.553768 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.553869 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.554078 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.554176 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.554402 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.554492 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.554726 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.554827 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.555038 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.555127 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.555347 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.555435 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.555651 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.555741 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.555929 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 18 10:20:00.556070 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.556295 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.556640 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.556947 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:20:00.557191 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 18 10:20:00.616977 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: INFO dbcounter [None req-4443a6cc-0299-4eec-b093-3f1886ae2b5f None None] Registered counter for database nova_api Jul 18 10:20:00.617185 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: INFO dbcounter [None req-e57657de-82d1-4f36-a850-7eac8b7b8148 None None] Registered counter for database nova_api Jul 18 10:20:00.729187 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG oslo_db.sqlalchemy.engines [None req-4443a6cc-0299-4eec-b093-3f1886ae2b5f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103150) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 18 10:20:00.730826 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG oslo_db.sqlalchemy.engines [None req-e57657de-82d1-4f36-a850-7eac8b7b8148 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103151) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 18 10:20:00.736019 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG dbcounter [-] [103150] Writer thread running {{(pid=103150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 18 10:20:00.738070 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG dbcounter [-] [103151] Writer thread running {{(pid=103151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 18 10:20:00.791051 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.context [None req-4443a6cc-0299-4eec-b093-3f1886ae2b5f None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),5fde33fe-e6c7-4fec-b6f1-087885458693(cell1) {{(pid=103150) load_cells /opt/stack/nova/nova/context.py:464}} Jul 18 10:20:00.791680 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.context [None req-e57657de-82d1-4f36-a850-7eac8b7b8148 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),5fde33fe-e6c7-4fec-b6f1-087885458693(cell1) {{(pid=103151) load_cells /opt/stack/nova/nova/context.py:464}} Jul 18 10:20:00.795039 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG oslo_concurrency.lockutils [None req-4443a6cc-0299-4eec-b093-3f1886ae2b5f None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:20:00.795609 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG oslo_concurrency.lockutils [None req-e57657de-82d1-4f36-a850-7eac8b7b8148 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:20:00.796608 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG oslo_concurrency.lockutils [None req-4443a6cc-0299-4eec-b093-3f1886ae2b5f None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:20:00.797195 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG oslo_concurrency.lockutils [None req-e57657de-82d1-4f36-a850-7eac8b7b8148 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:20:00.797416 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG oslo_concurrency.lockutils [None req-4443a6cc-0299-4eec-b093-3f1886ae2b5f None None] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:20:00.797998 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG oslo_concurrency.lockutils [None req-e57657de-82d1-4f36-a850-7eac8b7b8148 None None] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:20:00.800042 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG oslo_concurrency.lockutils [None req-4443a6cc-0299-4eec-b093-3f1886ae2b5f None None] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:20:00.800648 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG oslo_concurrency.lockutils [None req-e57657de-82d1-4f36-a850-7eac8b7b8148 None None] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:20:00.802027 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: INFO dbcounter [None req-4443a6cc-0299-4eec-b093-3f1886ae2b5f None None] Registered counter for database nova_cell0 Jul 18 10:20:00.802597 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: INFO dbcounter [None req-e57657de-82d1-4f36-a850-7eac8b7b8148 None None] Registered counter for database nova_cell0 Jul 18 10:20:00.806229 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: INFO dbcounter [None req-4443a6cc-0299-4eec-b093-3f1886ae2b5f None None] Registered counter for database nova_cell1 Jul 18 10:20:00.806351 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: INFO dbcounter [None req-e57657de-82d1-4f36-a850-7eac8b7b8148 None None] Registered counter for database nova_cell1 Jul 18 10:20:00.813623 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG oslo_db.sqlalchemy.engines [None req-4443a6cc-0299-4eec-b093-3f1886ae2b5f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103150) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 18 10:20:00.815853 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG oslo_db.sqlalchemy.engines [None req-e57657de-82d1-4f36-a850-7eac8b7b8148 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103151) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 18 10:20:00.818837 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG dbcounter [-] [103150] Writer thread running {{(pid=103150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 18 10:20:00.820966 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG dbcounter [-] [103151] Writer thread running {{(pid=103151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 18 10:20:00.821680 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG oslo_db.sqlalchemy.engines [None req-e57657de-82d1-4f36-a850-7eac8b7b8148 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103151) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 18 10:20:00.823078 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG oslo_db.sqlalchemy.engines [None req-4443a6cc-0299-4eec-b093-3f1886ae2b5f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103150) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 18 10:20:00.958644 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG dbcounter [-] [103150] Writer thread running {{(pid=103150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 18 10:20:00.960532 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG dbcounter [-] [103151] Writer thread running {{(pid=103151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 18 10:20:00.969981 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: INFO dbcounter [None req-4443a6cc-0299-4eec-b093-3f1886ae2b5f None None] Registered counter for database nova_cell0 Jul 18 10:20:00.970205 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: INFO dbcounter [None req-e57657de-82d1-4f36-a850-7eac8b7b8148 None None] Registered counter for database nova_cell0 Jul 18 10:20:00.978970 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG oslo_db.sqlalchemy.engines [None req-e57657de-82d1-4f36-a850-7eac8b7b8148 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103151) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 18 10:20:00.982642 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG oslo_db.sqlalchemy.engines [None req-4443a6cc-0299-4eec-b093-3f1886ae2b5f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103150) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 18 10:20:00.983616 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG dbcounter [-] [103151] Writer thread running {{(pid=103151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 18 10:20:00.987441 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG dbcounter [-] [103150] Writer thread running {{(pid=103150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 18 10:20:01.318659 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: WARNING keystonemiddleware.auth_token [None req-4443a6cc-0299-4eec-b093-3f1886ae2b5f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 18 10:20:01.320567 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: WARNING keystonemiddleware.auth_token [None req-e57657de-82d1-4f36-a850-7eac8b7b8148 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 18 10:20:01.326019 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: WARNING keystonemiddleware.auth_token [None req-4443a6cc-0299-4eec-b093-3f1886ae2b5f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 18 10:20:01.327751 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: WARNING keystonemiddleware.auth_token [None req-e57657de-82d1-4f36-a850-7eac8b7b8148 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 18 10:20:01.664773 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: WARNING keystonemiddleware.auth_token [None req-4443a6cc-0299-4eec-b093-3f1886ae2b5f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 18 10:20:01.667665 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: WARNING keystonemiddleware.auth_token [None req-e57657de-82d1-4f36-a850-7eac8b7b8148 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 18 10:20:01.670717 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: WARNING keystonemiddleware.auth_token [None req-4443a6cc-0299-4eec-b093-3f1886ae2b5f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 18 10:20:01.673671 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: WARNING keystonemiddleware.auth_token [None req-e57657de-82d1-4f36-a850-7eac8b7b8148 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 18 10:20:01.675954 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55f09e13a9c0 pid: 103150 (default app) Jul 18 10:20:01.678027 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi [None req-4443a6cc-0299-4eec-b093-3f1886ae2b5f None None] Calling method '>' {{(pid=103150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:20:01.678902 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55f09e13a9c0 pid: 103151 (default app) Jul 18 10:20:01.679214 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: INFO nova.api.openstack.requestlog [None req-4443a6cc-0299-4eec-b093-3f1886ae2b5f None None] 10.222.0.33 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001714 Jul 18 10:20:01.679626 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: [pid: 103150|app: 0|req: 1/1] 10.222.0.33 () {50 vars in 788 bytes} [Mon Jul 18 10:20:01 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:21:17.194685 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi [None req-e57657de-82d1-4f36-a850-7eac8b7b8148 None None] Calling method '>' {{(pid=103151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:21:17.195913 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: INFO nova.api.openstack.requestlog [None req-e57657de-82d1-4f36-a850-7eac8b7b8148 None None] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001965 Jul 18 10:21:17.196311 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: [pid: 103151|app: 0|req: 1/2] 10.222.0.33 () {54 vars in 930 bytes} [Mon Jul 18 10:21:17 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:21:17.208095 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG dbcounter [-] [103150] Writing DB stats nova_api:SELECT=3 {{(pid=103150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:21:17.209232 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG dbcounter [-] [103150] Writing DB stats nova_cell1:SELECT=3 {{(pid=103150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:21:17.209980 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG dbcounter [-] [103150] Writing DB stats nova_cell0:SELECT=3 {{(pid=103150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:21:17.210706 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG dbcounter [-] [103150] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:21:18.074750 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi [None req-44b5714e-a8d1-462a-951f-bf651f8e93cb admin admin] Calling method '>' {{(pid=103150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:21:18.105831 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: INFO nova.api.openstack.requestlog [None req-44b5714e-a8d1-462a-951f-bf651f8e93cb admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.903551 Jul 18 10:21:18.106905 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: [pid: 103150|app: 0|req: 2/3] 10.222.0.33 () {60 vars in 1291 bytes} [Mon Jul 18 10:21:17 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:21:20.332312 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi [None req-e57657de-82d1-4f36-a850-7eac8b7b8148 None None] Calling method '>' {{(pid=103151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:21:20.333547 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: INFO nova.api.openstack.requestlog [None req-e57657de-82d1-4f36-a850-7eac8b7b8148 None None] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001514 Jul 18 10:21:20.336859 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: [pid: 103151|app: 0|req: 2/4] 10.222.0.33 () {54 vars in 930 bytes} [Mon Jul 18 10:21:20 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:21:20.784963 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi [None req-a400394b-4ee8-4f6a-a2b3-ca34693bffb5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "vcpus": 1, "name": "cirros256", "rxtx_factor": 1.0, "disk": 1, "id": "c1", "swap": 0, "ram": 256}} {{(pid=103150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:21:20.804327 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 10:21:20.804327 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: warnings.warn(msg) Jul 18 10:21:20.834054 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: INFO nova.api.openstack.requestlog [None req-a400394b-4ee8-4f6a-a2b3-ca34693bffb5 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.494042 Jul 18 10:21:20.840662 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: [pid: 103150|app: 0|req: 3/5] 10.222.0.33 () {64 vars in 1282 bytes} [Mon Jul 18 10:21:20 2022] POST /compute/v2.1/flavors => generated 407 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 18 10:21:20.848788 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG dbcounter [-] [103151] Writing DB stats nova_api:SELECT=3 {{(pid=103151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:21:20.850064 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG dbcounter [-] [103151] Writing DB stats nova_cell0:SELECT=3 {{(pid=103151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:21:20.850996 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG dbcounter [-] [103151] Writing DB stats nova_cell1:SELECT=3 {{(pid=103151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:21:20.852403 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG dbcounter [-] [103151] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:21:21.061997 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi [None req-eacd7baf-6900-48cd-b78e-0b1482f8cb4b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:21:21.064453 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 10:21:21.064453 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: warnings.warn(msg) Jul 18 10:21:21.128870 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: INFO nova.api.openstack.requestlog [None req-eacd7baf-6900-48cd-b78e-0b1482f8cb4b admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.285714 Jul 18 10:21:21.129717 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: [pid: 103151|app: 0|req: 3/6] 10.222.0.33 () {64 vars in 1335 bytes} [Mon Jul 18 10:21:20 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:21:23.388345 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi [None req-a400394b-4ee8-4f6a-a2b3-ca34693bffb5 admin admin] Calling method '>' {{(pid=103150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:21:23.389440 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: INFO nova.api.openstack.requestlog [None req-a400394b-4ee8-4f6a-a2b3-ca34693bffb5 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001532 Jul 18 10:21:23.389846 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: [pid: 103150|app: 0|req: 4/7] 10.222.0.33 () {54 vars in 930 bytes} [Mon Jul 18 10:21:23 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:21:24.053027 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi [None req-9116ee8f-f6af-4734-b6db-9e72b94f347c admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "rxtx_factor": 1.0, "name": "ds512M", "ram": 512, "disk": 5, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "vcpus": 1, "id": "d1"}} {{(pid=103151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:21:24.072634 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 10:21:24.072634 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: warnings.warn(msg) Jul 18 10:21:24.095233 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: INFO nova.api.openstack.requestlog [None req-9116ee8f-f6af-4734-b6db-9e72b94f347c admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.698863 Jul 18 10:21:24.096142 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: [pid: 103151|app: 0|req: 4/8] 10.222.0.33 () {64 vars in 1282 bytes} [Mon Jul 18 10:21:23 2022] POST /compute/v2.1/flavors => generated 404 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 18 10:21:24.108269 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi [None req-db56db16-58ae-42d3-a522-25c16b43db4f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:21:24.110576 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 10:21:24.110576 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: warnings.warn(msg) Jul 18 10:21:24.144345 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: INFO nova.api.openstack.requestlog [None req-db56db16-58ae-42d3-a522-25c16b43db4f admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.040043 Jul 18 10:21:24.145305 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: [pid: 103150|app: 0|req: 5/9] 10.222.0.33 () {64 vars in 1335 bytes} [Mon Jul 18 10:21:24 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:21:26.359031 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi [None req-9116ee8f-f6af-4734-b6db-9e72b94f347c admin admin] Calling method '>' {{(pid=103151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:21:26.361008 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: INFO nova.api.openstack.requestlog [None req-9116ee8f-f6af-4734-b6db-9e72b94f347c admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001979 Jul 18 10:21:26.361487 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: [pid: 103151|app: 0|req: 5/10] 10.222.0.33 () {54 vars in 930 bytes} [Mon Jul 18 10:21:26 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 10:21:26.755195 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi [None req-4b92311b-5e06-4160-9805-762f63f2391b admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "name": "ds1G", "rxtx_factor": 1.0, "swap": 0, "disk": 10, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d2", "vcpus": 1}} {{(pid=103150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:21:26.772528 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: INFO nova.api.openstack.requestlog [None req-4b92311b-5e06-4160-9805-762f63f2391b admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.405540 Jul 18 10:21:26.773278 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: [pid: 103150|app: 0|req: 6/11] 10.222.0.33 () {64 vars in 1282 bytes} [Mon Jul 18 10:21:26 2022] POST /compute/v2.1/flavors => generated 404 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 10:21:26.785349 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi [None req-8ca45c22-2414-45b8-aee4-3a21ce9e85bb admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:21:26.807651 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: INFO nova.api.openstack.requestlog [None req-8ca45c22-2414-45b8-aee4-3a21ce9e85bb admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026457 Jul 18 10:21:26.808215 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: [pid: 103151|app: 0|req: 6/12] 10.222.0.33 () {64 vars in 1335 bytes} [Mon Jul 18 10:21:26 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:21:29.053326 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi [None req-4b92311b-5e06-4160-9805-762f63f2391b admin admin] Calling method '>' {{(pid=103150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:21:29.061899 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: INFO nova.api.openstack.requestlog [None req-4b92311b-5e06-4160-9805-762f63f2391b admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.009402 Jul 18 10:21:29.069514 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: [pid: 103150|app: 0|req: 7/13] 10.222.0.33 () {54 vars in 930 bytes} [Mon Jul 18 10:21:29 2022] GET /compute/v2.1 => generated 388 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:21:29.500575 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi [None req-853b1723-9f4f-4b40-b8cd-b63c1057e09a admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "swap": 0, "id": "d3", "vcpus": 2, "disk": 10, "ram": 2048, "os-flavor-access:is_public": true, "name": "ds2G"}} {{(pid=103151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:21:29.522208 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: INFO nova.api.openstack.requestlog [None req-853b1723-9f4f-4b40-b8cd-b63c1057e09a admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.448756 Jul 18 10:21:29.523320 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: [pid: 103151|app: 0|req: 7/14] 10.222.0.33 () {64 vars in 1282 bytes} [Mon Jul 18 10:21:29 2022] POST /compute/v2.1/flavors => generated 404 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 10:21:29.535958 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi [None req-3b968f8a-51b5-4a74-af12-bd9557968839 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:21:29.564761 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: INFO nova.api.openstack.requestlog [None req-3b968f8a-51b5-4a74-af12-bd9557968839 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033069 Jul 18 10:21:29.565447 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: [pid: 103150|app: 0|req: 8/15] 10.222.0.33 () {64 vars in 1335 bytes} [Mon Jul 18 10:21:29 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:21:31.787491 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi [None req-853b1723-9f4f-4b40-b8cd-b63c1057e09a admin admin] Calling method '>' {{(pid=103151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:21:31.788515 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: INFO nova.api.openstack.requestlog [None req-853b1723-9f4f-4b40-b8cd-b63c1057e09a admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001444 Jul 18 10:21:31.789174 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: [pid: 103151|app: 0|req: 8/16] 10.222.0.33 () {54 vars in 930 bytes} [Mon Jul 18 10:21:31 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:21:32.240744 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi [None req-86ecbd1a-0449-4ed9-a08e-665bb6b8c6a7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "os-flavor-access:is_public": true, "name": "ds4G", "id": "d4", "swap": 0, "rxtx_factor": 1.0, "ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 20}} {{(pid=103150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:21:32.258624 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: INFO nova.api.openstack.requestlog [None req-86ecbd1a-0449-4ed9-a08e-665bb6b8c6a7 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.463739 Jul 18 10:21:32.259327 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: [pid: 103150|app: 0|req: 9/17] 10.222.0.33 () {64 vars in 1282 bytes} [Mon Jul 18 10:21:31 2022] POST /compute/v2.1/flavors => generated 404 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 10:21:32.271747 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi [None req-6a5d96b3-9542-49db-bb1d-03bcee18cff9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:21:32.294424 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: INFO nova.api.openstack.requestlog [None req-6a5d96b3-9542-49db-bb1d-03bcee18cff9 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026276 Jul 18 10:21:32.295181 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: [pid: 103151|app: 0|req: 9/18] 10.222.0.33 () {64 vars in 1335 bytes} [Mon Jul 18 10:21:32 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:21:34.850042 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi [None req-86ecbd1a-0449-4ed9-a08e-665bb6b8c6a7 admin admin] Calling method '>' {{(pid=103150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:21:34.851060 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: INFO nova.api.openstack.requestlog [None req-86ecbd1a-0449-4ed9-a08e-665bb6b8c6a7 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001462 Jul 18 10:21:34.851502 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: [pid: 103150|app: 0|req: 10/19] 10.222.0.33 () {54 vars in 930 bytes} [Mon Jul 18 10:21:34 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:21:35.278759 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi [None req-aaf6171a-295e-4679-8b2b-746d9b62cd5a admin admin] Calling method '>' {{(pid=103151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:21:35.301813 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: INFO nova.api.openstack.requestlog [None req-aaf6171a-295e-4679-8b2b-746d9b62cd5a admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.443878 Jul 18 10:21:35.302375 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: [pid: 103151|app: 0|req: 10/20] 10.222.0.33 () {60 vars in 1291 bytes} [Mon Jul 18 10:21:34 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:21:37.903356 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi [None req-86ecbd1a-0449-4ed9-a08e-665bb6b8c6a7 admin admin] Calling method '>' {{(pid=103150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:21:37.904640 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: INFO nova.api.openstack.requestlog [None req-86ecbd1a-0449-4ed9-a08e-665bb6b8c6a7 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001714 Jul 18 10:21:37.905111 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: [pid: 103150|app: 0|req: 11/21] 10.222.0.33 () {54 vars in 930 bytes} [Mon Jul 18 10:21:37 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:21:38.345013 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi [None req-d2b94a4d-702f-4e07-a667-6562870da0fd admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "1", "rxtx_factor": 1.0, "name": "m1.tiny", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "os-flavor-access:is_public": true, "ram": 512, "swap": 0, "disk": 1}} {{(pid=103151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:21:38.364809 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: INFO nova.api.openstack.requestlog [None req-d2b94a4d-702f-4e07-a667-6562870da0fd admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.452224 Jul 18 10:21:38.365374 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: [pid: 103151|app: 0|req: 11/22] 10.222.0.33 () {64 vars in 1282 bytes} [Mon Jul 18 10:21:37 2022] POST /compute/v2.1/flavors => generated 402 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 18 10:21:38.377852 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi [None req-aa887643-daad-483a-a0aa-2a3ce19c7946 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:21:38.403966 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: INFO nova.api.openstack.requestlog [None req-aa887643-daad-483a-a0aa-2a3ce19c7946 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029798 Jul 18 10:21:38.404592 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: [pid: 103150|app: 0|req: 12/23] 10.222.0.33 () {64 vars in 1332 bytes} [Mon Jul 18 10:21:38 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:21:40.795427 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi [None req-d2b94a4d-702f-4e07-a667-6562870da0fd admin admin] Calling method '>' {{(pid=103151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:21:40.796512 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: INFO nova.api.openstack.requestlog [None req-d2b94a4d-702f-4e07-a667-6562870da0fd admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001510 Jul 18 10:21:40.796927 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: [pid: 103151|app: 0|req: 12/24] 10.222.0.33 () {54 vars in 930 bytes} [Mon Jul 18 10:21:40 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:21:41.306575 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi [None req-30c2e0d6-56af-4a2a-936a-83cbea23a383 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "ram": 2048, "disk": 20, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.small", "rxtx_factor": 1.0, "id": "2", "vcpus": 1}} {{(pid=103150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:21:41.324173 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: INFO nova.api.openstack.requestlog [None req-30c2e0d6-56af-4a2a-936a-83cbea23a383 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.521294 Jul 18 10:21:41.324688 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: [pid: 103150|app: 0|req: 13/25] 10.222.0.33 () {64 vars in 1282 bytes} [Mon Jul 18 10:21:40 2022] POST /compute/v2.1/flavors => generated 405 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 10:21:41.336434 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi [None req-10e76701-6e21-46e9-981a-b22610bd875f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:21:41.358236 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: INFO nova.api.openstack.requestlog [None req-10e76701-6e21-46e9-981a-b22610bd875f admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.025516 Jul 18 10:21:41.359486 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: [pid: 103151|app: 0|req: 13/26] 10.222.0.33 () {64 vars in 1332 bytes} [Mon Jul 18 10:21:41 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:21:43.594799 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi [None req-30c2e0d6-56af-4a2a-936a-83cbea23a383 admin admin] Calling method '>' {{(pid=103150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:21:43.595963 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: INFO nova.api.openstack.requestlog [None req-30c2e0d6-56af-4a2a-936a-83cbea23a383 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001520 Jul 18 10:21:43.596440 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: [pid: 103150|app: 0|req: 14/27] 10.222.0.33 () {54 vars in 930 bytes} [Mon Jul 18 10:21:43 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:21:44.012119 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi [None req-2e69b8ef-8f73-40d3-9abe-95d27c87b3b5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "name": "m1.medium", "id": "3", "os-flavor-access:is_public": true, "disk": 40, "rxtx_factor": 1.0, "swap": 0, "vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:21:44.040270 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: INFO nova.api.openstack.requestlog [None req-2e69b8ef-8f73-40d3-9abe-95d27c87b3b5 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.437514 Jul 18 10:21:44.041175 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: [pid: 103151|app: 0|req: 14/28] 10.222.0.33 () {64 vars in 1282 bytes} [Mon Jul 18 10:21:43 2022] POST /compute/v2.1/flavors => generated 406 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 10:21:44.054004 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi [None req-58cd2f2d-0785-43e7-b5a7-1eb370503a74 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:21:44.079496 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: INFO nova.api.openstack.requestlog [None req-58cd2f2d-0785-43e7-b5a7-1eb370503a74 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029324 Jul 18 10:21:44.080087 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: [pid: 103150|app: 0|req: 15/29] 10.222.0.33 () {64 vars in 1332 bytes} [Mon Jul 18 10:21:44 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:21:46.404312 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi [None req-2e69b8ef-8f73-40d3-9abe-95d27c87b3b5 admin admin] Calling method '>' {{(pid=103151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:21:46.409630 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: INFO nova.api.openstack.requestlog [None req-2e69b8ef-8f73-40d3-9abe-95d27c87b3b5 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.005753 Jul 18 10:21:46.410263 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: [pid: 103151|app: 0|req: 15/30] 10.222.0.33 () {54 vars in 930 bytes} [Mon Jul 18 10:21:46 2022] GET /compute/v2.1 => generated 388 bytes in 7 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:21:46.927891 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi [None req-da7988e1-1876-40c5-88c7-e14aa83a491f admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "4", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "vcpus": 4, "name": "m1.large", "disk": 80, "swap": 0, "ram": 8192}} {{(pid=103150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:21:46.949087 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: INFO nova.api.openstack.requestlog [None req-da7988e1-1876-40c5-88c7-e14aa83a491f admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.530757 Jul 18 10:21:46.950115 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: [pid: 103150|app: 0|req: 16/31] 10.222.0.33 () {64 vars in 1282 bytes} [Mon Jul 18 10:21:46 2022] POST /compute/v2.1/flavors => generated 405 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 10:21:46.961509 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi [None req-fc9ef563-5565-454b-82bc-42d78fc53656 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:21:46.985355 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: INFO nova.api.openstack.requestlog [None req-fc9ef563-5565-454b-82bc-42d78fc53656 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027383 Jul 18 10:21:46.986066 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: [pid: 103151|app: 0|req: 16/32] 10.222.0.33 () {64 vars in 1332 bytes} [Mon Jul 18 10:21:46 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:21:49.195507 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi [None req-da7988e1-1876-40c5-88c7-e14aa83a491f admin admin] Calling method '>' {{(pid=103150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:21:49.197194 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: INFO nova.api.openstack.requestlog [None req-da7988e1-1876-40c5-88c7-e14aa83a491f admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002101 Jul 18 10:21:49.197599 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: [pid: 103150|app: 0|req: 17/33] 10.222.0.33 () {54 vars in 930 bytes} [Mon Jul 18 10:21:49 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:21:49.658096 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi [None req-dca20701-4f58-4c20-9d13-acc9ed4366db admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 8, "name": "m1.xlarge", "disk": 160, "ram": 16384, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "id": "5", "os-flavor-access:is_public": true, "swap": 0}} {{(pid=103151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:21:49.679112 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: INFO nova.api.openstack.requestlog [None req-dca20701-4f58-4c20-9d13-acc9ed4366db admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.475622 Jul 18 10:21:49.679680 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: [pid: 103151|app: 0|req: 17/34] 10.222.0.33 () {64 vars in 1282 bytes} [Mon Jul 18 10:21:49 2022] POST /compute/v2.1/flavors => generated 408 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 10:21:49.692054 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi [None req-c77d09da-6df4-4f75-9b2f-53b2af0d3721 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:21:49.695636 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG dbcounter [-] [103150] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=9,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=103150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:21:49.715952 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: INFO nova.api.openstack.requestlog [None req-c77d09da-6df4-4f75-9b2f-53b2af0d3721 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027582 Jul 18 10:21:49.716545 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: [pid: 103150|app: 0|req: 18/35] 10.222.0.33 () {64 vars in 1332 bytes} [Mon Jul 18 10:21:49 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:22:08.797601 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi [None req-dca20701-4f58-4c20-9d13-acc9ed4366db admin admin] Calling method '>' {{(pid=103151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:22:08.798615 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: INFO nova.api.openstack.requestlog [None req-dca20701-4f58-4c20-9d13-acc9ed4366db admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001437 Jul 18 10:22:08.799050 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: [pid: 103151|app: 0|req: 18/36] 10.222.0.33 () {54 vars in 930 bytes} [Mon Jul 18 10:22:08 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 10:22:08.809945 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG dbcounter [-] [103150] Writing DB stats nova_api:SELECT=5,nova_api:SAVEPOINT=1,nova_api:INSERT=1,nova_api:RELEASE=1 {{(pid=103150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:22:09.192377 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi [None req-190a604a-528e-4a9c-bb9c-bbfe25d54bf6 admin admin] Calling method '>' {{(pid=103150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:22:09.208968 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: INFO nova.api.openstack.requestlog [None req-190a604a-528e-4a9c-bb9c-bbfe25d54bf6 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.403694 Jul 18 10:22:09.209439 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: [pid: 103150|app: 0|req: 19/37] 10.222.0.33 () {60 vars in 1291 bytes} [Mon Jul 18 10:22:08 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:22:10.282293 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi [None req-dca20701-4f58-4c20-9d13-acc9ed4366db admin admin] Calling method '>' {{(pid=103151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:22:10.283293 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: INFO nova.api.openstack.requestlog [None req-dca20701-4f58-4c20-9d13-acc9ed4366db admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001441 Jul 18 10:22:10.283696 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: [pid: 103151|app: 0|req: 19/38] 10.222.0.33 () {56 vars in 1074 bytes} [Mon Jul 18 10:22:10 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:22:10.808286 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi [None req-3fd09712-10eb-44fc-bea2-fd7441c06cc0 admin admin] Calling method '>' {{(pid=103150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:22:10.814382 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: INFO nova.api.openstack.wsgi [None req-3fd09712-10eb-44fc-bea2-fd7441c06cc0 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 18 10:22:10.817627 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi [None req-3fd09712-10eb-44fc-bea2-fd7441c06cc0 admin admin] Request method failure captured: Jul 18 10:22:10.817627 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 18 10:22:10.817627 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: Accept: application/json Jul 18 10:22:10.817627 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: Accept-Encoding: gzip, deflate Jul 18 10:22:10.817627 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: Connection: keep-alive Jul 18 10:22:10.817627 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: Content-Length: 0 Jul 18 10:22:10.817627 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: Host: 10.222.0.33 Jul 18 10:22:10.817627 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: Openstack-Api-Version: compute 2.90 Jul 18 10:22:10.817627 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: Openstack-System-Scope: None Jul 18 10:22:10.817627 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: User-Agent: python-novaclient Jul 18 10:22:10.817627 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: X-Auth-Token: gAAAAABi1TRSSsBWeRSRJye0ah17lCt55c5ZdkMBAXzaktIEUkX7vozu2PrSENRQ0ycV6CmbdPtetaaeeCkO0ZsySitX4kWo7oy2s53ZLctRGy4kAeY4DZGRx04bajLRzlULWy_Ij-J6Wkxytibap3lK8yKmrWLmCjfVIRNndPRnutn_Vlb767A Jul 18 10:22:10.817627 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: X-Domain-Id: None Jul 18 10:22:10.817627 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: X-Domain-Name: None Jul 18 10:22:10.817627 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: X-Identity-Status: Confirmed Jul 18 10:22:10.817627 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: X-Is-Admin-Project: True Jul 18 10:22:10.817627 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: X-Openstack-Nova-Api-Version: 2.90 Jul 18 10:22:10.817627 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: X-Project-Domain-Id: default Jul 18 10:22:10.817627 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: X-Project-Domain-Name: Default Jul 18 10:22:10.817627 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: X-Project-Id: 1282af50d400435ba3f0e00de6e5fb67 Jul 18 10:22:10.817627 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: X-Project-Name: admin Jul 18 10:22:10.817627 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: X-Role: member,admin,reader Jul 18 10:22:10.817627 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: X-Roles: member,admin,reader Jul 18 10:22:10.819271 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1282af50d400435ba3f0e00de6e5fb67"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1282af50d400435ba3f0e00de6e5fb67"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/1282af50d400435ba3f0e00de6e5fb67"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_1282af50d400435ba3f0e00de6e5fb67"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jul 18 10:22:10.819271 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: X-Tenant: admin Jul 18 10:22:10.819271 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: X-Tenant-Id: 1282af50d400435ba3f0e00de6e5fb67 Jul 18 10:22:10.819271 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: X-Tenant-Name: admin Jul 18 10:22:10.819271 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: X-User: admin Jul 18 10:22:10.819271 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: X-User-Domain-Id: default Jul 18 10:22:10.819271 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: X-User-Domain-Name: Default Jul 18 10:22:10.819271 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: X-User-Id: 06ec5a62dde8447fa4c9a00a0f1828f8 Jul 18 10:22:10.819271 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: X-User-Name: admin Jul 18 10:22:10.819271 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: method: > Jul 18 10:22:10.819271 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: exception: Flavor 42 could not be found. Jul 18 10:22:10.819271 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: action_args: {'id': '42'} Jul 18 10:22:10.819271 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: {{(pid=103150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 10:22:10.819271 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:22:10.820450 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 18 10:22:10.820450 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 18 10:22:10.820450 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 18 10:22:10.820450 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 18 10:22:10.820450 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 18 10:22:10.820450 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 18 10:22:10.820450 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 18 10:22:10.820450 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 18 10:22:10.820450 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 18 10:22:10.820450 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 10:22:10.820450 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 18 10:22:10.820450 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 18 10:22:10.820450 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 18 10:22:10.820450 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: ERROR nova.api.openstack.wsgi Jul 18 10:22:10.820450 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:22:10.820450 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: ERROR nova.api.openstack.wsgi Jul 18 10:22:10.820450 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:22:10.820450 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:22:10.820450 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:22:10.822008 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 10:22:10.822008 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 10:22:10.822008 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 10:22:10.822008 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 10:22:10.822008 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 18 10:22:10.822008 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 18 10:22:10.822008 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 18 10:22:10.822008 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: ERROR nova.api.openstack.wsgi Jul 18 10:22:10.822008 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:22:10.822008 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: ERROR nova.api.openstack.wsgi Jul 18 10:22:10.822008 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:22:10.822008 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:22:10.822008 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:22:10.822008 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 10:22:10.822008 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 10:22:10.822008 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 18 10:22:10.822008 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: ERROR nova.api.openstack.wsgi Jul 18 10:22:10.822008 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi [None req-3fd09712-10eb-44fc-bea2-fd7441c06cc0 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103150) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 10:22:10.823371 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: INFO nova.api.openstack.requestlog [None req-3fd09712-10eb-44fc-bea2-fd7441c06cc0 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.395610 Jul 18 10:22:10.823371 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: [pid: 103150|app: 0|req: 20/39] 10.222.0.33 () {60 vars in 1190 bytes} [Mon Jul 18 10:22:10 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 397 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 18 10:22:10.828710 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi [None req-7c3214be-8b7a-4907-9ec2-73a6bf96e605 admin admin] Calling method '>' {{(pid=103151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:22:10.831621 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG dbcounter [-] [103151] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=103151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:22:10.851669 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: INFO nova.api.openstack.requestlog [None req-7c3214be-8b7a-4907-9ec2-73a6bf96e605 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026610 Jul 18 10:22:10.852196 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: [pid: 103151|app: 0|req: 20/40] 10.222.0.33 () {60 vars in 1210 bytes} [Mon Jul 18 10:22:10 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:22:10.862652 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi [None req-64ea5c7d-6240-4802-a64e-d57366db2dff admin admin] Calling method '>' {{(pid=103150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:22:10.884386 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: INFO nova.api.openstack.requestlog [None req-64ea5c7d-6240-4802-a64e-d57366db2dff admin admin] 10.222.0.33 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025168 Jul 18 10:22:10.884953 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: [pid: 103150|app: 0|req: 21/41] 10.222.0.33 () {60 vars in 1210 bytes} [Mon Jul 18 10:22:10 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:22:10.895932 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi [None req-76ead44d-04c5-4c8d-a6c4-558b0b748f7c admin admin] Calling method '>' {{(pid=103151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:22:10.902176 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: INFO nova.api.openstack.wsgi [None req-76ead44d-04c5-4c8d-a6c4-558b0b748f7c admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 18 10:22:10.906076 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi [None req-76ead44d-04c5-4c8d-a6c4-558b0b748f7c admin admin] Request method failure captured: Jul 18 10:22:10.906076 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 18 10:22:10.906076 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: Accept: application/json Jul 18 10:22:10.906076 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: Accept-Encoding: gzip, deflate Jul 18 10:22:10.906076 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: Connection: keep-alive Jul 18 10:22:10.906076 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: Content-Length: 0 Jul 18 10:22:10.906076 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: Host: 10.222.0.33 Jul 18 10:22:10.906076 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: Openstack-Api-Version: compute 2.90 Jul 18 10:22:10.906076 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: Openstack-System-Scope: None Jul 18 10:22:10.906076 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: User-Agent: python-novaclient Jul 18 10:22:10.906076 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: X-Auth-Token: gAAAAABi1TRSSsBWeRSRJye0ah17lCt55c5ZdkMBAXzaktIEUkX7vozu2PrSENRQ0ycV6CmbdPtetaaeeCkO0ZsySitX4kWo7oy2s53ZLctRGy4kAeY4DZGRx04bajLRzlULWy_Ij-J6Wkxytibap3lK8yKmrWLmCjfVIRNndPRnutn_Vlb767A Jul 18 10:22:10.906076 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: X-Domain-Id: None Jul 18 10:22:10.906076 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: X-Domain-Name: None Jul 18 10:22:10.906076 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: X-Identity-Status: Confirmed Jul 18 10:22:10.906076 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: X-Is-Admin-Project: True Jul 18 10:22:10.906076 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: X-Openstack-Nova-Api-Version: 2.90 Jul 18 10:22:10.906076 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: X-Project-Domain-Id: default Jul 18 10:22:10.906076 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: X-Project-Domain-Name: Default Jul 18 10:22:10.906076 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: X-Project-Id: 1282af50d400435ba3f0e00de6e5fb67 Jul 18 10:22:10.906076 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: X-Project-Name: admin Jul 18 10:22:10.906076 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: X-Role: member,admin,reader Jul 18 10:22:10.906076 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: X-Roles: member,admin,reader Jul 18 10:22:10.907628 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1282af50d400435ba3f0e00de6e5fb67"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1282af50d400435ba3f0e00de6e5fb67"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/1282af50d400435ba3f0e00de6e5fb67"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_1282af50d400435ba3f0e00de6e5fb67"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jul 18 10:22:10.907628 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: X-Tenant: admin Jul 18 10:22:10.907628 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: X-Tenant-Id: 1282af50d400435ba3f0e00de6e5fb67 Jul 18 10:22:10.907628 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: X-Tenant-Name: admin Jul 18 10:22:10.907628 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: X-User: admin Jul 18 10:22:10.907628 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: X-User-Domain-Id: default Jul 18 10:22:10.907628 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: X-User-Domain-Name: Default Jul 18 10:22:10.907628 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: X-User-Id: 06ec5a62dde8447fa4c9a00a0f1828f8 Jul 18 10:22:10.907628 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: X-User-Name: admin Jul 18 10:22:10.907628 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: method: > Jul 18 10:22:10.907628 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: exception: Flavor 42 could not be found. Jul 18 10:22:10.907628 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: action_args: {'id': '42'} Jul 18 10:22:10.907628 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: {{(pid=103151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 10:22:10.907628 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:22:10.908526 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 18 10:22:10.908526 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 18 10:22:10.908526 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 18 10:22:10.908526 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 18 10:22:10.908526 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 18 10:22:10.908526 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 18 10:22:10.908526 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 18 10:22:10.908526 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 18 10:22:10.908526 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 18 10:22:10.908526 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 10:22:10.908526 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 18 10:22:10.908526 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 18 10:22:10.908526 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 18 10:22:10.908526 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi Jul 18 10:22:10.908526 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:22:10.908526 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi Jul 18 10:22:10.908526 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:22:10.908526 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:22:10.908526 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:22:10.909588 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 10:22:10.909588 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 10:22:10.909588 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 10:22:10.909588 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 10:22:10.909588 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 18 10:22:10.909588 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 18 10:22:10.909588 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 18 10:22:10.909588 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi Jul 18 10:22:10.909588 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:22:10.909588 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi Jul 18 10:22:10.909588 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:22:10.909588 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:22:10.909588 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:22:10.909588 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 10:22:10.909588 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 10:22:10.909588 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 18 10:22:10.909588 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi Jul 18 10:22:10.909588 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi [None req-76ead44d-04c5-4c8d-a6c4-558b0b748f7c admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103151) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 10:22:10.910566 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: INFO nova.api.openstack.requestlog [None req-76ead44d-04c5-4c8d-a6c4-558b0b748f7c admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.016718 Jul 18 10:22:10.910566 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: [pid: 103151|app: 0|req: 21/42] 10.222.0.33 () {60 vars in 1190 bytes} [Mon Jul 18 10:22:10 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 18 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jul 18 10:22:11.907347 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi [None req-64ea5c7d-6240-4802-a64e-d57366db2dff admin admin] Calling method '>' {{(pid=103150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:22:11.908351 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: INFO nova.api.openstack.requestlog [None req-64ea5c7d-6240-4802-a64e-d57366db2dff admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001441 Jul 18 10:22:11.908789 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: [pid: 103150|app: 0|req: 22/43] 10.222.0.33 () {56 vars in 1074 bytes} [Mon Jul 18 10:22:11 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:22:12.425671 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi [None req-f06a592d-9b07-4a53-847d-49ac24e6e488 admin admin] Calling method '>' {{(pid=103151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:22:12.431188 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: INFO nova.api.openstack.wsgi [None req-f06a592d-9b07-4a53-847d-49ac24e6e488 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 18 10:22:12.432802 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi [None req-f06a592d-9b07-4a53-847d-49ac24e6e488 admin admin] Request method failure captured: Jul 18 10:22:12.432802 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 18 10:22:12.432802 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: Accept: application/json Jul 18 10:22:12.432802 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: Accept-Encoding: gzip, deflate Jul 18 10:22:12.432802 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: Connection: keep-alive Jul 18 10:22:12.432802 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: Content-Length: 0 Jul 18 10:22:12.432802 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: Host: 10.222.0.33 Jul 18 10:22:12.432802 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: Openstack-Api-Version: compute 2.90 Jul 18 10:22:12.432802 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: Openstack-System-Scope: None Jul 18 10:22:12.432802 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: User-Agent: python-novaclient Jul 18 10:22:12.432802 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: X-Auth-Token: gAAAAABi1TRTZdgY24v5SMC8cWprcNTM0VlAfN-GrATQBZGoJ1F5CDAbL-F3JZ1gOKJahf-i7WaBpH5Q9h8M3qYpH8U7rY3IWSvGnDB0ipY9etfe7Hvu2WaBOH8F-7q7SYYWtyf56QUQodv1uhO7cCF-E-pfNpoFEmYRn-TMQup5dzAC_k-o9l4 Jul 18 10:22:12.432802 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: X-Domain-Id: None Jul 18 10:22:12.432802 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: X-Domain-Name: None Jul 18 10:22:12.432802 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: X-Identity-Status: Confirmed Jul 18 10:22:12.432802 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: X-Is-Admin-Project: True Jul 18 10:22:12.432802 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: X-Openstack-Nova-Api-Version: 2.90 Jul 18 10:22:12.432802 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: X-Project-Domain-Id: default Jul 18 10:22:12.432802 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: X-Project-Domain-Name: Default Jul 18 10:22:12.432802 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: X-Project-Id: 1282af50d400435ba3f0e00de6e5fb67 Jul 18 10:22:12.432802 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: X-Project-Name: admin Jul 18 10:22:12.432802 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: X-Role: member,admin,reader Jul 18 10:22:12.432802 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: X-Roles: member,admin,reader Jul 18 10:22:12.434376 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1282af50d400435ba3f0e00de6e5fb67"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1282af50d400435ba3f0e00de6e5fb67"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/1282af50d400435ba3f0e00de6e5fb67"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_1282af50d400435ba3f0e00de6e5fb67"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jul 18 10:22:12.434376 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: X-Tenant: admin Jul 18 10:22:12.434376 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: X-Tenant-Id: 1282af50d400435ba3f0e00de6e5fb67 Jul 18 10:22:12.434376 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: X-Tenant-Name: admin Jul 18 10:22:12.434376 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: X-User: admin Jul 18 10:22:12.434376 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: X-User-Domain-Id: default Jul 18 10:22:12.434376 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: X-User-Domain-Name: Default Jul 18 10:22:12.434376 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: X-User-Id: 06ec5a62dde8447fa4c9a00a0f1828f8 Jul 18 10:22:12.434376 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: X-User-Name: admin Jul 18 10:22:12.434376 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: method: > Jul 18 10:22:12.434376 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: exception: Flavor 84 could not be found. Jul 18 10:22:12.434376 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: action_args: {'id': '84'} Jul 18 10:22:12.434376 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: {{(pid=103151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 10:22:12.434376 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:22:12.435238 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 18 10:22:12.435238 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 18 10:22:12.435238 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 18 10:22:12.435238 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 18 10:22:12.435238 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 18 10:22:12.435238 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 18 10:22:12.435238 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 18 10:22:12.435238 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 18 10:22:12.435238 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 18 10:22:12.435238 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 10:22:12.435238 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 18 10:22:12.435238 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 18 10:22:12.435238 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 18 10:22:12.435238 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi Jul 18 10:22:12.435238 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:22:12.435238 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi Jul 18 10:22:12.435238 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:22:12.435238 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:22:12.435238 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:22:12.436287 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 10:22:12.436287 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 10:22:12.436287 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 10:22:12.436287 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 10:22:12.436287 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 18 10:22:12.436287 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 18 10:22:12.436287 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 18 10:22:12.436287 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi Jul 18 10:22:12.436287 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:22:12.436287 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi Jul 18 10:22:12.436287 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:22:12.436287 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:22:12.436287 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:22:12.436287 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 10:22:12.436287 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 10:22:12.436287 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 18 10:22:12.436287 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi Jul 18 10:22:12.436287 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi [None req-f06a592d-9b07-4a53-847d-49ac24e6e488 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103151) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 10:22:12.437393 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: INFO nova.api.openstack.requestlog [None req-f06a592d-9b07-4a53-847d-49ac24e6e488 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.388533 Jul 18 10:22:12.437393 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: [pid: 103151|app: 0|req: 22/44] 10.222.0.33 () {60 vars in 1190 bytes} [Mon Jul 18 10:22:12 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 390 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 18 10:22:12.443845 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi [None req-114ed4aa-5b7a-461e-b322-99a3c15cbf70 admin admin] Calling method '>' {{(pid=103150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:22:12.457277 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: INFO nova.api.openstack.requestlog [None req-114ed4aa-5b7a-461e-b322-99a3c15cbf70 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017063 Jul 18 10:22:12.457795 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: [pid: 103150|app: 0|req: 23/45] 10.222.0.33 () {60 vars in 1210 bytes} [Mon Jul 18 10:22:12 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:22:12.466921 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi [None req-3ee37ef0-b596-41f7-8ef9-867b94725e15 admin admin] Calling method '>' {{(pid=103151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:22:12.481217 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: INFO nova.api.openstack.requestlog [None req-3ee37ef0-b596-41f7-8ef9-867b94725e15 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017500 Jul 18 10:22:12.481731 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: [pid: 103151|app: 0|req: 23/46] 10.222.0.33 () {60 vars in 1210 bytes} [Mon Jul 18 10:22:12 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:22:12.491217 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi [None req-bcd22703-59a0-44c8-8e39-ccce5241c9a3 admin admin] Calling method '>' {{(pid=103150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:22:12.496359 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: INFO nova.api.openstack.wsgi [None req-bcd22703-59a0-44c8-8e39-ccce5241c9a3 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 18 10:22:12.497906 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi [None req-bcd22703-59a0-44c8-8e39-ccce5241c9a3 admin admin] Request method failure captured: Jul 18 10:22:12.497906 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 18 10:22:12.497906 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: Accept: application/json Jul 18 10:22:12.497906 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: Accept-Encoding: gzip, deflate Jul 18 10:22:12.497906 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: Connection: keep-alive Jul 18 10:22:12.497906 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: Content-Length: 0 Jul 18 10:22:12.497906 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: Host: 10.222.0.33 Jul 18 10:22:12.497906 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: Openstack-Api-Version: compute 2.90 Jul 18 10:22:12.497906 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: Openstack-System-Scope: None Jul 18 10:22:12.497906 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: User-Agent: python-novaclient Jul 18 10:22:12.497906 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: X-Auth-Token: gAAAAABi1TRTZdgY24v5SMC8cWprcNTM0VlAfN-GrATQBZGoJ1F5CDAbL-F3JZ1gOKJahf-i7WaBpH5Q9h8M3qYpH8U7rY3IWSvGnDB0ipY9etfe7Hvu2WaBOH8F-7q7SYYWtyf56QUQodv1uhO7cCF-E-pfNpoFEmYRn-TMQup5dzAC_k-o9l4 Jul 18 10:22:12.497906 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: X-Domain-Id: None Jul 18 10:22:12.497906 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: X-Domain-Name: None Jul 18 10:22:12.497906 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: X-Identity-Status: Confirmed Jul 18 10:22:12.497906 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: X-Is-Admin-Project: True Jul 18 10:22:12.497906 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: X-Openstack-Nova-Api-Version: 2.90 Jul 18 10:22:12.497906 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: X-Project-Domain-Id: default Jul 18 10:22:12.497906 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: X-Project-Domain-Name: Default Jul 18 10:22:12.497906 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: X-Project-Id: 1282af50d400435ba3f0e00de6e5fb67 Jul 18 10:22:12.497906 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: X-Project-Name: admin Jul 18 10:22:12.497906 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: X-Role: member,admin,reader Jul 18 10:22:12.497906 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: X-Roles: member,admin,reader Jul 18 10:22:12.499481 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1282af50d400435ba3f0e00de6e5fb67"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1282af50d400435ba3f0e00de6e5fb67"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/1282af50d400435ba3f0e00de6e5fb67"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_1282af50d400435ba3f0e00de6e5fb67"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jul 18 10:22:12.499481 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: X-Tenant: admin Jul 18 10:22:12.499481 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: X-Tenant-Id: 1282af50d400435ba3f0e00de6e5fb67 Jul 18 10:22:12.499481 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: X-Tenant-Name: admin Jul 18 10:22:12.499481 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: X-User: admin Jul 18 10:22:12.499481 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: X-User-Domain-Id: default Jul 18 10:22:12.499481 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: X-User-Domain-Name: Default Jul 18 10:22:12.499481 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: X-User-Id: 06ec5a62dde8447fa4c9a00a0f1828f8 Jul 18 10:22:12.499481 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: X-User-Name: admin Jul 18 10:22:12.499481 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: method: > Jul 18 10:22:12.499481 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: exception: Flavor 84 could not be found. Jul 18 10:22:12.499481 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: action_args: {'id': '84'} Jul 18 10:22:12.499481 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: {{(pid=103150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 10:22:12.499481 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:22:12.500457 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 18 10:22:12.500457 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 18 10:22:12.500457 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 18 10:22:12.500457 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 18 10:22:12.500457 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 18 10:22:12.500457 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 18 10:22:12.500457 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 18 10:22:12.500457 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 18 10:22:12.500457 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 18 10:22:12.500457 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 10:22:12.500457 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 18 10:22:12.500457 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 18 10:22:12.500457 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 18 10:22:12.500457 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: ERROR nova.api.openstack.wsgi Jul 18 10:22:12.500457 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:22:12.500457 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: ERROR nova.api.openstack.wsgi Jul 18 10:22:12.500457 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:22:12.500457 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:22:12.500457 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:22:12.501823 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 10:22:12.501823 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 10:22:12.501823 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 10:22:12.501823 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 10:22:12.501823 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 18 10:22:12.501823 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 18 10:22:12.501823 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 18 10:22:12.501823 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: ERROR nova.api.openstack.wsgi Jul 18 10:22:12.501823 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:22:12.501823 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: ERROR nova.api.openstack.wsgi Jul 18 10:22:12.501823 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:22:12.501823 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:22:12.501823 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:22:12.501823 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 10:22:12.501823 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 10:22:12.501823 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 18 10:22:12.501823 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: ERROR nova.api.openstack.wsgi Jul 18 10:22:12.501823 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi [None req-bcd22703-59a0-44c8-8e39-ccce5241c9a3 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103150) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 10:22:12.503095 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: INFO nova.api.openstack.requestlog [None req-bcd22703-59a0-44c8-8e39-ccce5241c9a3 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.011581 Jul 18 10:22:12.503095 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: [pid: 103150|app: 0|req: 24/47] 10.222.0.33 () {60 vars in 1190 bytes} [Mon Jul 18 10:22:12 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 18 10:22:13.459548 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi [None req-3ee37ef0-b596-41f7-8ef9-867b94725e15 admin admin] Calling method '>' {{(pid=103151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:22:13.460586 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: INFO nova.api.openstack.requestlog [None req-3ee37ef0-b596-41f7-8ef9-867b94725e15 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001440 Jul 18 10:22:13.460985 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: [pid: 103151|app: 0|req: 24/48] 10.222.0.33 () {56 vars in 1074 bytes} [Mon Jul 18 10:22:13 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:22:13.984843 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi [None req-857a9251-4525-40a6-bb27-07b88119420e admin admin] Calling method '>' {{(pid=103150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:22:13.990500 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: INFO nova.api.openstack.wsgi [None req-857a9251-4525-40a6-bb27-07b88119420e admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 18 10:22:13.991994 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi [None req-857a9251-4525-40a6-bb27-07b88119420e admin admin] Request method failure captured: Jul 18 10:22:13.991994 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 18 10:22:13.991994 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: Accept: application/json Jul 18 10:22:13.991994 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: Accept-Encoding: gzip, deflate Jul 18 10:22:13.991994 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: Connection: keep-alive Jul 18 10:22:13.991994 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: Content-Length: 0 Jul 18 10:22:13.991994 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: Host: 10.222.0.33 Jul 18 10:22:13.991994 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: Openstack-Api-Version: compute 2.90 Jul 18 10:22:13.991994 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: Openstack-System-Scope: None Jul 18 10:22:13.991994 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: User-Agent: python-novaclient Jul 18 10:22:13.991994 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: X-Auth-Token: gAAAAABi1TRVgvonaoulVPvYghQ1muCq_JoVpvYLTf3SS_LkSb6n2U_zKSptNysHZBGNdL5XwM98i9S3y8VblnhUOkcFQCssw2Q0v6DZdFsty8KWNulZbxaMUNMhtOT6PDoM50ovTI7jIm2AEIexaWIneyPSdhsPblbd03AKJoDSVBMYgdDnkII Jul 18 10:22:13.991994 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: X-Domain-Id: None Jul 18 10:22:13.991994 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: X-Domain-Name: None Jul 18 10:22:13.991994 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: X-Identity-Status: Confirmed Jul 18 10:22:13.991994 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: X-Is-Admin-Project: True Jul 18 10:22:13.991994 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: X-Openstack-Nova-Api-Version: 2.90 Jul 18 10:22:13.991994 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: X-Project-Domain-Id: default Jul 18 10:22:13.991994 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: X-Project-Domain-Name: Default Jul 18 10:22:13.991994 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: X-Project-Id: 1282af50d400435ba3f0e00de6e5fb67 Jul 18 10:22:13.991994 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: X-Project-Name: admin Jul 18 10:22:13.991994 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: X-Role: member,admin,reader Jul 18 10:22:13.991994 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: X-Roles: member,admin,reader Jul 18 10:22:13.993635 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1282af50d400435ba3f0e00de6e5fb67"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1282af50d400435ba3f0e00de6e5fb67"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/1282af50d400435ba3f0e00de6e5fb67"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_1282af50d400435ba3f0e00de6e5fb67"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jul 18 10:22:13.993635 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: X-Tenant: admin Jul 18 10:22:13.993635 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: X-Tenant-Id: 1282af50d400435ba3f0e00de6e5fb67 Jul 18 10:22:13.993635 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: X-Tenant-Name: admin Jul 18 10:22:13.993635 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: X-User: admin Jul 18 10:22:13.993635 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: X-User-Domain-Id: default Jul 18 10:22:13.993635 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: X-User-Domain-Name: Default Jul 18 10:22:13.993635 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: X-User-Id: 06ec5a62dde8447fa4c9a00a0f1828f8 Jul 18 10:22:13.993635 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: X-User-Name: admin Jul 18 10:22:13.993635 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: method: > Jul 18 10:22:13.993635 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: exception: Flavor 451 could not be found. Jul 18 10:22:13.993635 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: action_args: {'id': '451'} Jul 18 10:22:13.993635 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: {{(pid=103150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 10:22:13.993635 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:22:13.994868 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 18 10:22:13.994868 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 18 10:22:13.994868 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 18 10:22:13.994868 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 18 10:22:13.994868 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 18 10:22:13.994868 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 18 10:22:13.994868 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 18 10:22:13.994868 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 18 10:22:13.994868 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 18 10:22:13.994868 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 10:22:13.994868 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 18 10:22:13.994868 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 18 10:22:13.994868 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 18 10:22:13.994868 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: ERROR nova.api.openstack.wsgi Jul 18 10:22:13.994868 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:22:13.994868 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: ERROR nova.api.openstack.wsgi Jul 18 10:22:13.994868 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:22:13.994868 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:22:13.994868 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:22:13.996217 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 10:22:13.996217 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 10:22:13.996217 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 10:22:13.996217 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 10:22:13.996217 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 18 10:22:13.996217 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 18 10:22:13.996217 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 18 10:22:13.996217 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: ERROR nova.api.openstack.wsgi Jul 18 10:22:13.996217 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:22:13.996217 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: ERROR nova.api.openstack.wsgi Jul 18 10:22:13.996217 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:22:13.996217 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:22:13.996217 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:22:13.996217 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 10:22:13.996217 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 10:22:13.996217 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 18 10:22:13.996217 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: ERROR nova.api.openstack.wsgi Jul 18 10:22:13.996217 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi [None req-857a9251-4525-40a6-bb27-07b88119420e admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103150) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 10:22:13.997500 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: INFO nova.api.openstack.requestlog [None req-857a9251-4525-40a6-bb27-07b88119420e admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.395435 Jul 18 10:22:13.997500 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: [pid: 103150|app: 0|req: 25/49] 10.222.0.33 () {60 vars in 1193 bytes} [Mon Jul 18 10:22:13 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 396 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 18 10:22:14.003495 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi [None req-1d1868ce-c17c-4cd1-bf1f-01de2b544c25 admin admin] Calling method '>' {{(pid=103151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:22:14.017528 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: INFO nova.api.openstack.requestlog [None req-1d1868ce-c17c-4cd1-bf1f-01de2b544c25 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017553 Jul 18 10:22:14.018048 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: [pid: 103151|app: 0|req: 25/50] 10.222.0.33 () {60 vars in 1210 bytes} [Mon Jul 18 10:22:13 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:22:14.027216 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi [None req-f1f22843-5a2d-4774-8686-05cec65b2b84 admin admin] Calling method '>' {{(pid=103150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:22:14.041753 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: INFO nova.api.openstack.requestlog [None req-f1f22843-5a2d-4774-8686-05cec65b2b84 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018054 Jul 18 10:22:14.042283 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: [pid: 103150|app: 0|req: 26/51] 10.222.0.33 () {60 vars in 1210 bytes} [Mon Jul 18 10:22:14 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:22:14.051412 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi [None req-f6bee3c9-fe78-4f00-aac9-1d3152b14f77 admin admin] Calling method '>' {{(pid=103151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:22:14.056680 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: INFO nova.api.openstack.wsgi [None req-f6bee3c9-fe78-4f00-aac9-1d3152b14f77 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 18 10:22:14.058162 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi [None req-f6bee3c9-fe78-4f00-aac9-1d3152b14f77 admin admin] Request method failure captured: Jul 18 10:22:14.058162 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 18 10:22:14.058162 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: Accept: application/json Jul 18 10:22:14.058162 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: Accept-Encoding: gzip, deflate Jul 18 10:22:14.058162 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: Connection: keep-alive Jul 18 10:22:14.058162 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: Content-Length: 0 Jul 18 10:22:14.058162 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: Host: 10.222.0.33 Jul 18 10:22:14.058162 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: Openstack-Api-Version: compute 2.90 Jul 18 10:22:14.058162 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: Openstack-System-Scope: None Jul 18 10:22:14.058162 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: User-Agent: python-novaclient Jul 18 10:22:14.058162 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: X-Auth-Token: gAAAAABi1TRVgvonaoulVPvYghQ1muCq_JoVpvYLTf3SS_LkSb6n2U_zKSptNysHZBGNdL5XwM98i9S3y8VblnhUOkcFQCssw2Q0v6DZdFsty8KWNulZbxaMUNMhtOT6PDoM50ovTI7jIm2AEIexaWIneyPSdhsPblbd03AKJoDSVBMYgdDnkII Jul 18 10:22:14.058162 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: X-Domain-Id: None Jul 18 10:22:14.058162 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: X-Domain-Name: None Jul 18 10:22:14.058162 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: X-Identity-Status: Confirmed Jul 18 10:22:14.058162 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: X-Is-Admin-Project: True Jul 18 10:22:14.058162 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: X-Openstack-Nova-Api-Version: 2.90 Jul 18 10:22:14.058162 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: X-Project-Domain-Id: default Jul 18 10:22:14.058162 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: X-Project-Domain-Name: Default Jul 18 10:22:14.058162 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: X-Project-Id: 1282af50d400435ba3f0e00de6e5fb67 Jul 18 10:22:14.058162 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: X-Project-Name: admin Jul 18 10:22:14.058162 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: X-Role: member,admin,reader Jul 18 10:22:14.058162 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: X-Roles: member,admin,reader Jul 18 10:22:14.059788 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1282af50d400435ba3f0e00de6e5fb67"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1282af50d400435ba3f0e00de6e5fb67"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/1282af50d400435ba3f0e00de6e5fb67"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_1282af50d400435ba3f0e00de6e5fb67"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jul 18 10:22:14.059788 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: X-Tenant: admin Jul 18 10:22:14.059788 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: X-Tenant-Id: 1282af50d400435ba3f0e00de6e5fb67 Jul 18 10:22:14.059788 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: X-Tenant-Name: admin Jul 18 10:22:14.059788 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: X-User: admin Jul 18 10:22:14.059788 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: X-User-Domain-Id: default Jul 18 10:22:14.059788 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: X-User-Domain-Name: Default Jul 18 10:22:14.059788 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: X-User-Id: 06ec5a62dde8447fa4c9a00a0f1828f8 Jul 18 10:22:14.059788 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: X-User-Name: admin Jul 18 10:22:14.059788 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: method: > Jul 18 10:22:14.059788 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: exception: Flavor 451 could not be found. Jul 18 10:22:14.059788 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: action_args: {'id': '451'} Jul 18 10:22:14.059788 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: {{(pid=103151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 10:22:14.059788 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:22:14.061474 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 18 10:22:14.061474 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 18 10:22:14.061474 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 18 10:22:14.061474 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 18 10:22:14.061474 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 18 10:22:14.061474 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 18 10:22:14.061474 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 18 10:22:14.061474 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 18 10:22:14.061474 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 18 10:22:14.061474 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 10:22:14.061474 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 18 10:22:14.061474 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 18 10:22:14.061474 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 18 10:22:14.061474 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi Jul 18 10:22:14.061474 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:22:14.061474 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi Jul 18 10:22:14.061474 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:22:14.061474 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:22:14.061474 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:22:14.062844 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 10:22:14.062844 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 10:22:14.062844 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 10:22:14.062844 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 10:22:14.062844 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 18 10:22:14.062844 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 18 10:22:14.062844 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 18 10:22:14.062844 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi Jul 18 10:22:14.062844 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:22:14.062844 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi Jul 18 10:22:14.062844 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:22:14.062844 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:22:14.062844 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:22:14.062844 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 10:22:14.062844 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 10:22:14.062844 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 18 10:22:14.062844 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi Jul 18 10:22:14.062844 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi [None req-f6bee3c9-fe78-4f00-aac9-1d3152b14f77 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103151) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 10:22:14.064135 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: INFO nova.api.openstack.requestlog [None req-f6bee3c9-fe78-4f00-aac9-1d3152b14f77 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.011564 Jul 18 10:22:14.064135 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: [pid: 103151|app: 0|req: 26/52] 10.222.0.33 () {60 vars in 1193 bytes} [Mon Jul 18 10:22:14 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 18 10:22:15.023118 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi [None req-f1f22843-5a2d-4774-8686-05cec65b2b84 admin admin] Calling method '>' {{(pid=103150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:22:15.024116 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: INFO nova.api.openstack.requestlog [None req-f1f22843-5a2d-4774-8686-05cec65b2b84 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001416 Jul 18 10:22:15.024519 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: [pid: 103150|app: 0|req: 27/53] 10.222.0.33 () {56 vars in 1074 bytes} [Mon Jul 18 10:22:15 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:22:15.537128 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi [None req-4d7041bb-63a9-4d98-83a7-d4d833ffd653 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:22:15.554055 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: INFO nova.api.openstack.requestlog [None req-4d7041bb-63a9-4d98-83a7-d4d833ffd653 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.393960 Jul 18 10:22:15.554593 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: [pid: 103151|app: 0|req: 27/54] 10.222.0.33 () {64 vars in 1235 bytes} [Mon Jul 18 10:22:15 2022] POST /compute/v2.1/flavors => generated 404 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 10:22:16.525196 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi [None req-f1f22843-5a2d-4774-8686-05cec65b2b84 admin admin] Calling method '>' {{(pid=103150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:22:16.526193 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: INFO nova.api.openstack.requestlog [None req-f1f22843-5a2d-4774-8686-05cec65b2b84 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001451 Jul 18 10:22:16.526590 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: [pid: 103150|app: 0|req: 28/55] 10.222.0.33 () {56 vars in 1074 bytes} [Mon Jul 18 10:22:16 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:22:17.045204 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi [None req-00579949-d8b3-4fea-a577-8ac9cc14755f admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:22:17.062352 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: INFO nova.api.openstack.requestlog [None req-00579949-d8b3-4fea-a577-8ac9cc14755f admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.397457 Jul 18 10:22:17.062902 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: [pid: 103151|app: 0|req: 28/56] 10.222.0.33 () {64 vars in 1235 bytes} [Mon Jul 18 10:22:16 2022] POST /compute/v2.1/flavors => generated 405 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 10:22:18.033230 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi [None req-f1f22843-5a2d-4774-8686-05cec65b2b84 admin admin] Calling method '>' {{(pid=103150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:22:18.034256 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: INFO nova.api.openstack.requestlog [None req-f1f22843-5a2d-4774-8686-05cec65b2b84 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001435 Jul 18 10:22:18.034655 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: [pid: 103150|app: 0|req: 29/57] 10.222.0.33 () {56 vars in 1074 bytes} [Mon Jul 18 10:22:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:22:18.548762 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi [None req-ad69a010-1a54-460d-ba7f-11e64222aec7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:22:18.565502 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: INFO nova.api.openstack.requestlog [None req-ad69a010-1a54-460d-ba7f-11e64222aec7 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.391622 Jul 18 10:22:18.566051 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: [pid: 103151|app: 0|req: 29/58] 10.222.0.33 () {64 vars in 1235 bytes} [Mon Jul 18 10:22:18 2022] POST /compute/v2.1/flavors => generated 407 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 10:22:19.531298 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi [None req-f1f22843-5a2d-4774-8686-05cec65b2b84 admin admin] Calling method '>' {{(pid=103150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:22:19.532297 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: INFO nova.api.openstack.requestlog [None req-f1f22843-5a2d-4774-8686-05cec65b2b84 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001413 Jul 18 10:22:19.532741 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: [pid: 103150|app: 0|req: 30/59] 10.222.0.33 () {56 vars in 1074 bytes} [Mon Jul 18 10:22:19 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:22:20.054333 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi [None req-360af966-ce00-42e9-afa8-5b8dfc006499 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:22:20.072485 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: INFO nova.api.openstack.requestlog [None req-360af966-ce00-42e9-afa8-5b8dfc006499 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.400959 Jul 18 10:22:20.073047 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: [pid: 103151|app: 0|req: 30/60] 10.222.0.33 () {64 vars in 1235 bytes} [Mon Jul 18 10:22:19 2022] POST /compute/v2.1/flavors => generated 409 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 10:22:21.039607 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi [None req-f1f22843-5a2d-4774-8686-05cec65b2b84 admin admin] Calling method '>' {{(pid=103150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:22:21.040633 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: INFO nova.api.openstack.requestlog [None req-f1f22843-5a2d-4774-8686-05cec65b2b84 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001410 Jul 18 10:22:21.041035 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: [pid: 103150|app: 0|req: 31/61] 10.222.0.33 () {56 vars in 1074 bytes} [Mon Jul 18 10:22:21 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:22:21.564667 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi [None req-0bc8a6c4-b368-42b2-857f-18c099e454db admin admin] Calling method '>' {{(pid=103151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:22:21.584104 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: INFO nova.api.openstack.requestlog [None req-0bc8a6c4-b368-42b2-857f-18c099e454db admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.398096 Jul 18 10:22:21.584661 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: [pid: 103151|app: 0|req: 31/62] 10.222.0.33 () {60 vars in 1202 bytes} [Mon Jul 18 10:22:21 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:23:12.891932 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi [None req-f1f22843-5a2d-4774-8686-05cec65b2b84 admin admin] Calling method '>' {{(pid=103150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:23:12.892962 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: INFO nova.api.openstack.requestlog [None req-f1f22843-5a2d-4774-8686-05cec65b2b84 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001440 Jul 18 10:23:12.893362 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: [pid: 103150|app: 0|req: 32/63] 10.222.0.33 () {54 vars in 930 bytes} [Mon Jul 18 10:23:12 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:23:12.903581 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG dbcounter [-] [103151] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:13.295614 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi [None req-dbacda79-8863-4b65-b9b5-0ee51977f3ff admin admin] Calling method '>' {{(pid=103151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:23:13.314287 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: INFO nova.api.openstack.requestlog [None req-dbacda79-8863-4b65-b9b5-0ee51977f3ff admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.415096 Jul 18 10:23:13.314738 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: [pid: 103151|app: 0|req: 32/64] 10.222.0.33 () {60 vars in 1291 bytes} [Mon Jul 18 10:23:12 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 10:23:13.337287 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi [None req-1c959819-8b20-4746-aee8-d3d26153dc39 admin admin] Calling method '>' {{(pid=103150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:23:13.341300 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG dbcounter [-] [103150] Writing DB stats nova_api:SELECT=14 {{(pid=103150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:13.346812 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: INFO nova.api.openstack.requestlog [None req-1c959819-8b20-4746-aee8-d3d26153dc39 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013174 Jul 18 10:23:13.347337 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: [pid: 103150|app: 0|req: 33/65] 10.222.0.33 () {60 vars in 1282 bytes} [Mon Jul 18 10:23:13 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:23:13.359301 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi [None req-deaaca73-7836-43c7-8f76-4532e776c7af admin admin] Calling method '>' {{(pid=103151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:23:13.366681 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: INFO nova.api.openstack.requestlog [None req-deaaca73-7836-43c7-8f76-4532e776c7af admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011729 Jul 18 10:23:13.367183 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: [pid: 103151|app: 0|req: 33/66] 10.222.0.33 () {60 vars in 1285 bytes} [Mon Jul 18 10:23:13 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:23:13.378232 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi [None req-4ebb8e37-7450-4c1e-9ff2-e79c25078b07 admin admin] Calling method '>' {{(pid=103150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:23:13.385538 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: INFO nova.api.openstack.requestlog [None req-4ebb8e37-7450-4c1e-9ff2-e79c25078b07 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011006 Jul 18 10:23:13.386070 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: [pid: 103150|app: 0|req: 34/67] 10.222.0.33 () {60 vars in 1285 bytes} [Mon Jul 18 10:23:13 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:23:13.396613 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi [None req-1f2e8b8f-57c3-46c8-8219-82150cb563b9 admin admin] Calling method '>' {{(pid=103151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:23:13.404258 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: INFO nova.api.openstack.requestlog [None req-1f2e8b8f-57c3-46c8-8219-82150cb563b9 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010961 Jul 18 10:23:13.404802 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: [pid: 103151|app: 0|req: 34/68] 10.222.0.33 () {60 vars in 1282 bytes} [Mon Jul 18 10:23:13 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:26:50.018038 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi [None req-4ebb8e37-7450-4c1e-9ff2-e79c25078b07 admin admin] Calling method '>' {{(pid=103150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:26:50.019051 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: INFO nova.api.openstack.requestlog [None req-4ebb8e37-7450-4c1e-9ff2-e79c25078b07 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001463 Jul 18 10:26:50.019461 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: [pid: 103150|app: 0|req: 35/69] 10.222.0.33 () {56 vars in 1074 bytes} [Mon Jul 18 10:26:50 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 10:26:50.168280 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG dbcounter [-] [103151] Writing DB stats nova_api:SELECT=6 {{(pid=103151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:26:50.329526 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi [None req-bd420c06-2a35-43f1-81c3-ca203c440b5e admin admin] Calling method '>' {{(pid=103151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:26:50.331350 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 10:26:50.331350 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: warnings.warn(msg) Jul 18 10:26:50.333447 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG oslo_concurrency.lockutils [None req-bd420c06-2a35-43f1-81c3-ca203c440b5e admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:26:50.333931 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG oslo_concurrency.lockutils [None req-bd420c06-2a35-43f1-81c3-ca203c440b5e admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:26:50.335745 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG oslo_concurrency.lockutils [None req-bd420c06-2a35-43f1-81c3-ca203c440b5e admin admin] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:26:50.336545 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG oslo_concurrency.lockutils [None req-bd420c06-2a35-43f1-81c3-ca203c440b5e admin admin] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:26:50.372678 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: INFO nova.api.openstack.requestlog [None req-bd420c06-2a35-43f1-81c3-ca203c440b5e admin admin] 10.222.0.33 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.205692 Jul 18 10:26:50.373257 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: [pid: 103151|app: 0|req: 35/70] 10.222.0.33 () {60 vars in 1193 bytes} [Mon Jul 18 10:26:50 2022] GET /compute/v2.1/os-services => generated 791 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 10:26:51.228196 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi [None req-4ebb8e37-7450-4c1e-9ff2-e79c25078b07 admin admin] Calling method '>' {{(pid=103150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:26:51.229217 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: INFO nova.api.openstack.requestlog [None req-4ebb8e37-7450-4c1e-9ff2-e79c25078b07 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001419 Jul 18 10:26:51.229611 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: [pid: 103150|app: 0|req: 36/71] 10.222.0.33 () {56 vars in 1074 bytes} [Mon Jul 18 10:26:51 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:26:51.422339 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi [None req-20cbfd3f-d0e5-4bef-9f4e-4c8e1bd0a364 admin admin] Calling method '>' {{(pid=103151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:26:51.423512 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 10:26:51.423512 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: warnings.warn(msg) Jul 18 10:26:51.424772 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG oslo_concurrency.lockutils [None req-20cbfd3f-d0e5-4bef-9f4e-4c8e1bd0a364 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:26:51.425217 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG oslo_concurrency.lockutils [None req-20cbfd3f-d0e5-4bef-9f4e-4c8e1bd0a364 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:26:51.426005 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG oslo_concurrency.lockutils [None req-20cbfd3f-d0e5-4bef-9f4e-4c8e1bd0a364 admin admin] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:26:51.426435 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG oslo_concurrency.lockutils [None req-20cbfd3f-d0e5-4bef-9f4e-4c8e1bd0a364 admin admin] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:26:51.445586 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: INFO nova.api.openstack.requestlog [None req-20cbfd3f-d0e5-4bef-9f4e-4c8e1bd0a364 admin admin] 10.222.0.33 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.076084 Jul 18 10:26:51.446347 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: [pid: 103151|app: 0|req: 36/72] 10.222.0.33 () {60 vars in 1193 bytes} [Mon Jul 18 10:26:51 2022] GET /compute/v2.1/os-services => generated 791 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 10:27:02.664955 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi [None req-4ebb8e37-7450-4c1e-9ff2-e79c25078b07 admin admin] Calling method '>' {{(pid=103150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:27:02.665956 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: INFO nova.api.openstack.requestlog [None req-4ebb8e37-7450-4c1e-9ff2-e79c25078b07 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001459 Jul 18 10:27:02.666353 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: [pid: 103150|app: 0|req: 37/73] 10.222.0.33 () {56 vars in 1074 bytes} [Mon Jul 18 10:27:02 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:27:02.810667 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG dbcounter [-] [103151] Writing DB stats nova_cell0:SELECT=4 {{(pid=103151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:27:02.811401 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG dbcounter [-] [103151] Writing DB stats nova_cell1:SELECT=4 {{(pid=103151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:27:02.812812 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG dbcounter [-] [103151] Writing DB stats nova_api:SELECT=8 {{(pid=103151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:27:02.860738 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi [None req-47d12dc3-f299-4257-afa5-a2f60d1498b7 admin admin] Calling method '>' {{(pid=103151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:27:02.862401 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 10:27:02.862401 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: warnings.warn(msg) Jul 18 10:27:02.863158 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG oslo_concurrency.lockutils [None req-47d12dc3-f299-4257-afa5-a2f60d1498b7 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:27:02.863597 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG oslo_concurrency.lockutils [None req-47d12dc3-f299-4257-afa5-a2f60d1498b7 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:27:02.864383 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG oslo_concurrency.lockutils [None req-47d12dc3-f299-4257-afa5-a2f60d1498b7 admin admin] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:27:02.864841 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG oslo_concurrency.lockutils [None req-47d12dc3-f299-4257-afa5-a2f60d1498b7 admin admin] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:27:02.890249 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: INFO nova.api.openstack.requestlog [None req-47d12dc3-f299-4257-afa5-a2f60d1498b7 admin admin] 10.222.0.33 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.083892 Jul 18 10:27:02.890730 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: [pid: 103151|app: 0|req: 37/74] 10.222.0.33 () {60 vars in 1193 bytes} [Mon Jul 18 10:27:02 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:27:03.732323 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi [None req-4ebb8e37-7450-4c1e-9ff2-e79c25078b07 admin admin] Calling method '>' {{(pid=103150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:27:03.733347 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: INFO nova.api.openstack.requestlog [None req-4ebb8e37-7450-4c1e-9ff2-e79c25078b07 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001445 Jul 18 10:27:03.733751 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: [pid: 103150|app: 0|req: 38/75] 10.222.0.33 () {56 vars in 1074 bytes} [Mon Jul 18 10:27:03 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:27:03.923031 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi [None req-3d3058ae-658a-410c-9a73-7e191a952abf admin admin] Calling method '>' {{(pid=103151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:27:03.924178 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 10:27:03.924178 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: warnings.warn(msg) Jul 18 10:27:03.925411 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG oslo_concurrency.lockutils [None req-3d3058ae-658a-410c-9a73-7e191a952abf admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:27:03.925843 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG oslo_concurrency.lockutils [None req-3d3058ae-658a-410c-9a73-7e191a952abf admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:27:03.926614 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG oslo_concurrency.lockutils [None req-3d3058ae-658a-410c-9a73-7e191a952abf admin admin] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:27:03.927036 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: DEBUG oslo_concurrency.lockutils [None req-3d3058ae-658a-410c-9a73-7e191a952abf admin admin] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:27:03.948601 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: INFO nova.api.openstack.requestlog [None req-3d3058ae-658a-410c-9a73-7e191a952abf admin admin] 10.222.0.33 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.075857 Jul 18 10:27:03.949388 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: [pid: 103151|app: 0|req: 38/76] 10.222.0.33 () {60 vars in 1193 bytes} [Mon Jul 18 10:27:03 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:28:02.987637 dv-cinder-837546-3-iscsi devstack@n-api.service[103149]: Mon Jul 18 10:28:02 2022 - graceful shutdown triggered... Jul 18 10:28:02.988145 dv-cinder-837546-3-iscsi devstack@n-api.service[103150]: Gracefully killing worker 1 (pid: 103150)... Jul 18 10:28:02.989463 dv-cinder-837546-3-iscsi devstack@n-api.service[103151]: Gracefully killing worker 2 (pid: 103151)... Jul 18 10:28:02.990149 dv-cinder-837546-3-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jul 18 10:28:03.988806 dv-cinder-837546-3-iscsi devstack@n-api.service[103149]: worker 1 buried after 1 seconds Jul 18 10:28:03.989400 dv-cinder-837546-3-iscsi devstack@n-api.service[103149]: worker 2 buried after 1 seconds Jul 18 10:28:03.989400 dv-cinder-837546-3-iscsi devstack@n-api.service[103149]: goodbye to uWSGI. Jul 18 10:28:03.990475 dv-cinder-837546-3-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jul 18 10:28:03.991024 dv-cinder-837546-3-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jul 18 10:28:03.994406 dv-cinder-837546-3-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 18 10:28:04.003686 dv-cinder-837546-3-iscsi devstack@n-api.service[117862]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 18 10:28:04.006250 dv-cinder-837546-3-iscsi devstack@n-api.service[117862]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Jul 18 10:28:04 2022] *** Jul 18 10:28:04.006426 dv-cinder-837546-3-iscsi devstack@n-api.service[117862]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 18 10:28:04.006426 dv-cinder-837546-3-iscsi devstack@n-api.service[117862]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 18 10:28:04.006426 dv-cinder-837546-3-iscsi devstack@n-api.service[117862]: nodename: dv-cinder-837546-3-iscsi Jul 18 10:28:04.006426 dv-cinder-837546-3-iscsi devstack@n-api.service[117862]: machine: x86_64 Jul 18 10:28:04.006426 dv-cinder-837546-3-iscsi devstack@n-api.service[117862]: clock source: unix Jul 18 10:28:04.006426 dv-cinder-837546-3-iscsi devstack@n-api.service[117862]: pcre jit disabled Jul 18 10:28:04.006426 dv-cinder-837546-3-iscsi devstack@n-api.service[117862]: detected number of CPU cores: 4 Jul 18 10:28:04.006426 dv-cinder-837546-3-iscsi devstack@n-api.service[117862]: current working directory: / Jul 18 10:28:04.006426 dv-cinder-837546-3-iscsi devstack@n-api.service[117862]: detected binary path: /usr/bin/uwsgi-core Jul 18 10:28:04.006426 dv-cinder-837546-3-iscsi devstack@n-api.service[117862]: your processes number limit is 47680 Jul 18 10:28:04.006426 dv-cinder-837546-3-iscsi devstack@n-api.service[117862]: your memory page size is 4096 bytes Jul 18 10:28:04.007836 dv-cinder-837546-3-iscsi devstack@n-api.service[117862]: detected max file descriptor number: 2048 Jul 18 10:28:04.007836 dv-cinder-837546-3-iscsi devstack@n-api.service[117862]: lock engine: pthread robust mutexes Jul 18 10:28:04.007836 dv-cinder-837546-3-iscsi devstack@n-api.service[117862]: thunder lock: enabled Jul 18 10:28:04.007836 dv-cinder-837546-3-iscsi devstack@n-api.service[117862]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 18 10:28:04.007836 dv-cinder-837546-3-iscsi devstack@n-api.service[117862]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 18 10:28:04.048415 dv-cinder-837546-3-iscsi devstack@n-api.service[117862]: Python main interpreter initialized at 0x55cb8914f9c0 Jul 18 10:28:04.048415 dv-cinder-837546-3-iscsi devstack@n-api.service[117862]: python threads support enabled Jul 18 10:28:04.048415 dv-cinder-837546-3-iscsi devstack@n-api.service[117862]: your server socket listen backlog is limited to 100 connections Jul 18 10:28:04.048415 dv-cinder-837546-3-iscsi devstack@n-api.service[117862]: your mercy for graceful operations on workers is 90 seconds Jul 18 10:28:04.048996 dv-cinder-837546-3-iscsi devstack@n-api.service[117862]: mapped 403077 bytes (393 KB) for 2 cores Jul 18 10:28:04.048996 dv-cinder-837546-3-iscsi devstack@n-api.service[117862]: *** Operational MODE: preforking *** Jul 18 10:28:04.049154 dv-cinder-837546-3-iscsi devstack@n-api.service[117862]: *** uWSGI is running in multiple interpreter mode *** Jul 18 10:28:04.049154 dv-cinder-837546-3-iscsi devstack@n-api.service[117862]: spawned uWSGI master process (pid: 117862) Jul 18 10:28:04.049352 dv-cinder-837546-3-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 18 10:28:04.049933 dv-cinder-837546-3-iscsi devstack@n-api.service[117862]: spawned uWSGI worker 1 (pid: 117879, cores: 1) Jul 18 10:28:04.050426 dv-cinder-837546-3-iscsi devstack@n-api.service[117862]: spawned uWSGI worker 2 (pid: 117880, cores: 1) Jul 18 10:28:04.051621 dv-cinder-837546-3-iscsi devstack@n-api.service[117862]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 18 10:28:04.715563 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 18 10:28:04.725553 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 18 10:28:05.891206 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 18 10:28:05.891206 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: from cryptography.utils import int_from_bytes Jul 18 10:28:05.891935 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 18 10:28:05.891935 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: from cryptography.utils import int_from_bytes Jul 18 10:28:05.895115 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 18 10:28:05.895115 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: from cryptography.utils import int_from_bytes Jul 18 10:28:05.895592 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 18 10:28:05.895592 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: from cryptography.utils import int_from_bytes Jul 18 10:28:08.213722 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 18 10:28:08.214385 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 18 10:28:08.214636 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 18 10:28:08.214894 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 18 10:28:08.215157 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 18 10:28:08.215551 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:28:08.215884 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:28:08.216211 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:28:08.216562 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:28:08.216911 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:28:08.217032 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 18 10:28:08.217379 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:28:08.217466 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 18 10:28:08.217549 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:28:08.217790 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 18 10:28:08.217895 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:28:08.218154 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 18 10:28:08.218263 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:28:08.218415 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 18 10:28:08.218544 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:28:08.218730 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:28:08.218839 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:28:08.219068 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-837546-3-iscsi {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:28:08.219178 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:28:08.219401 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:28:08.219500 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:28:08.219716 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:28:08.219811 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:28:08.220032 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:28:08.220134 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:28:08.220340 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:28:08.220442 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:28:08.220695 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:28:08.220895 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:28:08.221075 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:28:08.221251 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:28:08.221396 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:28:08.221550 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:28:08.221698 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:28:08.221852 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:28:08.223305 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:28:08.223305 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-837546-3-iscsi {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:28:08.223802 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:28:08.224019 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:28:08.224238 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:28:08.224454 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:28:08.224698 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:28:08.224915 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:28:08.225129 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:28:08.225340 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:28:08.226149 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:28:08.226398 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:28:08.226617 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:28:08.226838 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:28:08.227052 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:28:08.227269 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:28:08.227491 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:28:08.227491 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:28:08.227913 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:28:08.228137 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:28:08.228354 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:28:08.228354 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:28:08.228787 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-837546-3-iscsi {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:28:08.229005 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:28:08.229196 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:28:08.229658 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:28:08.229856 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:28:08.230012 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:28:08.230170 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:28:08.230358 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:28:08.230503 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:28:08.230654 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:28:08.230804 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:28:08.230994 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:28:08.231883 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:28:08.232048 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:28:08.232194 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:28:08.232412 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:28:08.232707 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:28:08.232874 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-837546-3-iscsi {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:28:08.233034 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:28:08.233185 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:28:08.233328 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:28:08.233477 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:28:08.233628 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:28:08.233781 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:28:08.233934 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:28:08.234087 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:28:08.234238 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:28:08.234387 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:28:08.234537 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:28:08.234707 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:28:08.234858 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:28:08.235065 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:28:08.235215 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:28:08.235365 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:28:08.235521 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:28:08.235665 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:28:08.235816 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:28:08.235966 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:28:08.236118 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:28:08.236268 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:28:08.236424 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:28:08.236424 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:28:08.236775 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:28:08.236930 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:28:08.237081 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:28:08.237081 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:28:08.237361 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:28:08.237504 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:28:08.237657 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:28:08.237657 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:28:08.237942 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:28:08.238097 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:28:08.238251 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:28:08.238404 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:28:08.238559 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:28:08.238701 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:28:08.238854 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:28:08.238854 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:28:08.239139 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:28:08.239283 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:28:08.239431 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:28:08.239582 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:28:08.239811 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:28:08.239973 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:28:08.240117 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:28:08.240259 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:28:08.240421 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:28:08.240606 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:28:08.240765 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:28:08.240918 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:28:08.241064 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:28:08.241224 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:28:08.242083 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:28:08.242249 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:28:08.242403 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:28:08.242546 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:28:08.242697 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:28:08.242858 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:28:08.243010 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:28:08.243163 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:28:08.243315 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:28:08.243458 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:28:08.243610 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:28:08.243781 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:28:08.243781 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:28:08.244231 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.33 {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:28:08.244231 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.33 {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:28:08.244579 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:28:08.244741 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:28:08.244896 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:28:08.245056 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:28:08.245210 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:28:08.245210 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:28:08.245501 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:28:08.245501 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:28:08.245789 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:28:08.245789 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:28:08.246083 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:28:08.246227 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:28:08.246376 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:28:08.246376 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:28:08.246711 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.33 {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:28:08.246864 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:28:08.247025 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.33 {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:28:08.247177 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:28:08.247331 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:28:08.247485 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:28:08.247638 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:28:08.247808 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:28:08.248000 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:28:08.248153 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:28:08.248303 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:28:08.248456 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:28:08.248644 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:28:08.248802 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:28:08.248964 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:28:08.249107 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:28:08.249256 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:28:08.249407 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:28:08.249558 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:28:08.249715 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:28:08.249858 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:28:08.250000 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:28:08.250141 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:28:08.250289 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:28:08.250445 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:28:08.250597 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:28:08.250748 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:28:08.250748 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:28:08.251035 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:28:08.251179 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:28:08.251329 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:28:08.252163 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:28:08.252331 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:28:08.252478 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:28:08.252668 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:28:08.252822 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:28:08.252982 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:28:08.253125 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:28:08.253266 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:28:08.253408 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:28:08.253574 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:28:08.253725 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:28:08.253877 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:28:08.254020 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:28:08.254177 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:28:08.254320 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:28:08.254473 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:28:08.254631 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:28:08.254785 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:28:08.254928 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:28:08.255152 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:28:08.255329 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:28:08.255479 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:28:08.255647 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:28:08.255798 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:28:08.255942 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:28:08.256096 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:28:08.256240 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:28:08.256390 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:28:08.256562 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:28:08.256722 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:28:08.256873 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:28:08.257031 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:28:08.257175 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:28:08.257316 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:28:08.257457 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:28:08.257616 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:28:08.257761 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:28:08.257912 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:28:08.258103 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:28:08.258260 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:28:08.258417 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:28:08.258567 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:28:08.258711 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:28:08.258861 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:28:08.259004 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:28:08.259153 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:28:08.259311 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:28:08.259470 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:28:08.259614 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:28:08.259763 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:28:08.259918 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:28:08.260067 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:28:08.260259 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:28:08.260407 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:28:08.260576 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:28:08.260726 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:28:08.260877 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:28:08.261033 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:28:08.261742 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:28:08.261869 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:28:08.261953 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:28:08.262037 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:28:08.262110 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:28:08.262198 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:28:08.262281 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:28:08.262360 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:28:08.262432 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:28:08.262502 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:28:08.262571 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:28:08.262655 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:28:08.262728 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:28:08.262728 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:28:08.262865 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:28:08.262937 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:28:08.263007 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:28:08.263089 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:28:08.263169 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:28:08.263240 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:28:08.263317 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:28:08.263403 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:28:08.263488 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:28:08.263561 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:28:08.263636 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:28:08.263709 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:28:08.263785 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.263863 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:28:08.263943 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.264014 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:28:08.264084 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.264160 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:28:08.264160 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:28:08.264313 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.264394 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:28:08.264477 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.264597 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:28:08.264673 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.264750 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.264839 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.264839 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.264990 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.265060 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.265129 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.265198 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.265276 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.265355 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.265433 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.265514 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.265585 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.265654 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.265791 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.265865 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.265934 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.266019 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.266098 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.266177 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.266261 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.266341 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.266412 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.266482 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.266565 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.266652 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.266724 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.266803 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.266876 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.266945 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.267022 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.267094 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.267172 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.267245 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.267322 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.267407 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.267483 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.267561 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.267645 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.267724 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.267803 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.267885 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.267965 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.268044 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.268132 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.268212 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.268284 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.268354 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.268423 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.268493 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.269221 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.269386 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.269542 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.269705 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.269873 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.270038 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.270183 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.270336 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.270487 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.270632 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.270781 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.270942 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.271093 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.271343 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.271498 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.271653 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.271808 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.271965 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.272110 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.272252 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.273574 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.273737 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.273882 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.274040 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.274185 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.274335 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.274486 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.274630 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.274910 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.275082 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.275341 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.275486 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.275630 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.275783 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.275937 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.276081 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.276224 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.276368 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.276546 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.276698 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.276857 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.277009 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.277169 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.277322 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.277466 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.277608 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.277760 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.277912 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.278056 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.278056 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.278334 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.278478 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.278633 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.278789 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.278933 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.279085 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.279294 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.279456 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.279602 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.279754 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.279905 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.280051 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.280051 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.280339 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.280483 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.280701 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.280855 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.281008 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.281169 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.281326 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.281478 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.281629 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.281772 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.281772 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.281772 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.281772 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.282324 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.282467 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.282619 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.282763 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.282940 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.283410 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.283817 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.283971 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.284115 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.284276 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.284582 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.284737 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.284899 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.285124 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.285300 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.285514 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.285671 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.285827 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.285969 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.286113 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.286263 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.286414 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.286567 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.286719 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.286871 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.287022 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.287176 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.287329 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.287480 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.287623 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.287774 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.287917 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.288706 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.288866 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.289011 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.289155 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.289298 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.289448 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.289591 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.289748 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.289891 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.290044 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.290205 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.290357 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.290501 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.290658 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.290812 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.290967 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.291120 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.291272 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.291426 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.291571 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.291722 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.291873 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.292025 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.292184 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.292407 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.292573 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.292573 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.292863 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.293005 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.293164 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.293594 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.294006 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.294158 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.294302 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.294444 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.294587 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.294751 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.294983 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.296003 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.296163 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.296317 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.296477 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.296729 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.296877 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.297020 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.297162 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.297312 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.297465 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.297610 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.297771 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.297915 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.298067 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.298219 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.298377 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.298529 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.298737 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.298895 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.299046 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.299190 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.299346 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.299500 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.299652 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.299806 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.299962 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.300118 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.300269 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.300412 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.300595 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.300754 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.300905 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.301059 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.301204 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.301345 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.301487 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.301629 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.301782 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.301940 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.302092 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.302242 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.302386 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.302528 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.302670 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.302827 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.302972 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.303122 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.303272 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.303719 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.304138 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.304302 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.304456 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.304650 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.304797 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.304941 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.305094 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.305254 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.305466 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.305639 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.305859 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.306018 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.306173 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.306336 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.306480 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.306622 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.306763 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.306913 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.307075 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.307219 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.307361 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.307502 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.307651 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.307793 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.307943 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.308087 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.308239 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.308380 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.308585 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.308749 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.308895 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.309044 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.309189 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.309337 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.309337 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.309631 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.309776 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.309919 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.310071 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.310226 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.310383 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.310593 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.310748 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.310891 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.311043 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.311195 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.311346 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.311500 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.311651 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.311801 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.311952 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.312116 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.312284 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.312435 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.312614 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.312767 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.312911 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.313053 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.313205 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.313357 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.313778 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.313961 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.314345 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.314498 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.314662 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.314806 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.314957 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.315108 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.315251 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.315402 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.315638 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.315788 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.316012 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.316168 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.316311 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.316455 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.316661 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.316818 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.316970 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.317114 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.318008 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.318168 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.318321 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.318465 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.318619 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.318772 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.318924 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.319068 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.319247 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.319247 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.319562 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.319721 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.319866 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.320021 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.320172 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.320324 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.320477 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.320648 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.320792 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.320935 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.321079 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.321232 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.321402 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.321558 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.321703 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.321853 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.321996 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.322139 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.322291 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.322434 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.322577 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.322721 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.322864 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.323015 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.323165 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.323326 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.323481 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.323952 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.324109 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.324658 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.324824 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.324977 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.325120 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.325263 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.325414 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.325568 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.325807 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.325967 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.326268 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.326439 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.326601 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.326746 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.326889 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.327033 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.327185 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.327336 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.327495 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.327653 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.327805 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.327950 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.328112 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.328112 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.328394 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.328394 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.328696 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.328850 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.329003 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.329146 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.329529 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.329686 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.329831 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.329997 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.330149 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.330314 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.330451 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.330725 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.330864 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.330978 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.331098 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.331229 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.331372 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.331505 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.331606 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.331704 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.331799 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.331886 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.331986 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.332120 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.332211 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.332306 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.332401 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.332497 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.332616 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.332713 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.332808 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.332895 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.332980 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.333073 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.333177 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.333265 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.333351 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.333445 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.333532 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.333630 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.333630 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.333912 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.334207 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.334302 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.334479 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.334772 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.335412 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.335502 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.335598 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.335697 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.335805 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.335951 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.336051 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.336147 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.336252 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.336387 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.336477 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.336620 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.336710 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.336812 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.336901 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.336986 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.336986 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.337154 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.337248 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.337335 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.337428 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.337523 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.337523 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.337697 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.337783 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.337867 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.337951 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.338046 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.338147 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.338243 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.338338 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.338426 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.338520 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.338616 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.338715 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.338809 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.338903 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.338989 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.339082 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.339178 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.339265 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.339359 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.339445 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.339530 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.339615 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.339709 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.340386 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.340517 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.340623 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.340713 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.340807 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.340904 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.341000 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.341095 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.341189 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.341290 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.341384 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.341480 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.341568 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.341680 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.341854 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.341949 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.342056 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.342146 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.342239 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.342334 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.342429 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.342524 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.342654 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.342751 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.342839 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.342932 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.343019 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.343104 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.343199 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.343293 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.343380 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.343380 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.343545 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.343641 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.343738 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.343833 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.343920 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.344069 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.344416 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.344577 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.344731 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.344839 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.344936 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.345031 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.345126 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.345227 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.345322 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.345441 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.345519 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.345613 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.345707 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.345808 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.345896 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.345984 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.346065 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.346158 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.346246 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.346345 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.346427 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.346498 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.346719 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.346823 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.346925 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.347013 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.347108 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.347203 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.347297 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.347384 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.347551 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.347648 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.347735 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.347829 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.347976 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.348083 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.348289 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.348386 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.348627 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.348738 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.348941 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.349037 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.349252 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.349348 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.349558 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.349652 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.349865 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.349969 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.350168 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.350271 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.350546 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.351129 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.351355 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.351467 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.351669 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.351771 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.351984 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.352088 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.352295 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.352404 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.352650 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.352762 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.352971 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.353074 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.353287 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.353390 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.353602 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.353703 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.353915 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.354009 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.354220 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.354584 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.354798 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.354924 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.355113 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.355223 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.355432 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.355598 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.355753 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.355898 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.356056 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.356211 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.356377 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.356555 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.356726 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.356874 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.357039 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.357231 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.357396 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.357671 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.357993 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.358390 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.358725 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.359057 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.359380 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.359682 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.359997 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.360309 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.360475 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.360678 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.360840 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.361000 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.361158 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.361308 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.361457 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.361622 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.361782 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.361941 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.362100 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.362261 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.362418 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.362578 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.362730 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.363366 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.363366 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.363622 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.363713 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.363811 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.363900 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.363993 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.364081 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.364167 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.364299 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.364393 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.364642 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.364749 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.364981 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.365151 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.365258 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.365355 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.365586 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.365690 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.365906 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.366010 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.366277 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.366418 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.366620 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.366762 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.367067 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.367215 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.367321 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.367411 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.367574 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.367693 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.367898 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.368037 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.368220 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.368355 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.368600 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.368969 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.369080 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.369292 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.369397 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.369631 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.369768 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.369957 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.370074 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.370280 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.370385 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.370639 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.370744 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.370976 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.371081 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.371303 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.371422 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.371617 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.371726 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.371947 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.372060 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.372251 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.372363 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.372577 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.372688 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.372884 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.372994 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.373207 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.373301 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.373510 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.373609 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.373828 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.373945 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.374225 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.374320 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.374543 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.374652 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.374847 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.374996 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.375165 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.375373 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.375525 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.375667 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.375822 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.375964 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.376122 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.376274 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.376466 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.376658 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.376817 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.376980 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.377131 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.377275 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.377416 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.377590 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.377743 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.377894 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.378146 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.378300 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.378464 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.378621 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.378763 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.378923 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.379072 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.379213 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.379433 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.379577 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.379728 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.379866 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.380009 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.380149 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.380299 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.380449 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.380619 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.380781 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.380885 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.381108 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.381205 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.381429 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.381522 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.381826 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.381967 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.382074 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.382165 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.382382 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.382484 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.382687 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.382797 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.382996 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.383092 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.383302 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.383437 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.383606 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.383777 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.383909 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.384099 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.384204 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.384433 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.384572 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.384794 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.384982 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.385235 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.385329 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.385416 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.385590 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.385719 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.385894 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.386036 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.386215 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.386353 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.386520 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.386686 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.386840 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.387000 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.387154 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.387321 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.387475 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.387641 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.387795 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.387959 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.388099 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.388273 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.388420 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.388630 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.388735 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.388965 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.389073 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.389280 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.389390 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.389614 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.389709 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.389943 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.390039 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.390243 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.390350 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.390562 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.390659 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.390890 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.390984 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.391216 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.391321 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.391528 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.391661 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.391837 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.391939 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.392151 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.392283 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.392465 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.392634 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.392846 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.392979 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.393162 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.393285 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.393492 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.393621 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.393827 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.394026 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.394156 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.394271 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.394417 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.394546 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.394719 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.394839 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.395021 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.395151 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.395359 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.395489 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.395603 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.395731 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.395903 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.396052 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.396362 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.396689 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.396996 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.397839 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.397967 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.398160 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.398297 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.398463 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.398635 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.398769 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.398967 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.399070 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.399295 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.399391 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.399621 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.399731 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.399955 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.400058 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.400278 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.400382 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.401380 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.401555 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.401697 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.401814 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.401814 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.402022 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.402121 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.402218 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.402306 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.402393 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.402479 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.402564 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.402564 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.402742 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.402837 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.402962 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.403136 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.403284 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.403493 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.403599 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.403813 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.403917 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.404168 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.404325 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.404494 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.404653 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.404844 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.404938 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.405163 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.405267 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.405495 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.405726 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.405822 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.406055 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.406154 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.406370 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.406493 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.406685 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.406802 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.406994 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.407097 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.407307 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.407403 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.407619 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.407714 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.407929 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.408037 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.408237 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.408332 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.408565 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.408686 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.408876 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.408981 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.409201 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.409297 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.409521 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.409844 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.409939 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.410179 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.410277 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.410495 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.410590 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.410810 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.410920 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.411123 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.411219 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.411435 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.411529 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.411757 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.411865 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.412079 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.412175 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.412387 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.412480 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.412723 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.412831 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.413586 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.413700 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.413911 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.414008 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.414226 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.414333 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.414538 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.414649 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.414849 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.414944 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.415161 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.415258 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.415489 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.415625 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.415781 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.415887 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.416093 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.416188 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.416427 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.416555 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.416803 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.416926 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.417072 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.417168 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.417392 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.417490 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.417704 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.417809 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.418015 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.418111 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.418331 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.418426 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.418686 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.418832 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.419011 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.419150 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.419333 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.419481 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.419655 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.419808 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.419982 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.420125 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.420305 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.420442 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.420654 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.420764 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.420989 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.421085 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.421334 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.421443 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.421665 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.421760 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.421977 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.422070 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.422285 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.422394 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.422587 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.422682 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.422904 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.423133 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.423237 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.423457 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.423554 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.423800 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.423902 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.424104 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.424197 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.424460 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.424660 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.424879 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.425010 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.425206 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.425311 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.425542 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.425640 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.425857 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.425954 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.426172 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.426280 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.426537 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.426646 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.426808 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.427041 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.427147 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.427246 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.427421 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.427545 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.427734 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.427843 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.428046 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.428215 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.428377 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.428606 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.428792 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.428946 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.429236 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.429398 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.429664 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.429833 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.429983 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.430310 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.430646 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.430972 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.431290 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.431626 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.431898 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.432021 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.432244 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.432346 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.432591 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.432702 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.432919 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.433028 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.433235 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.433340 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.433550 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.433649 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.433866 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.433973 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.434182 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.434279 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.434494 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.434592 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.434813 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.434931 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.435125 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.435229 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.435461 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.435565 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.435823 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.435974 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.436114 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.436290 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.436392 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.436719 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.436832 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.437033 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.437136 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.437343 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.437469 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.437703 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.437887 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.438039 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.438200 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.438344 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.438494 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.438637 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.438792 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.438954 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.439105 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.439247 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.439390 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.439531 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.439687 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.439831 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.439982 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.440124 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.440348 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.440571 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.440684 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.440776 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.440998 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.441100 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.441384 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.441568 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.441708 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.441831 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.442018 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.442334 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.442433 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.442661 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.442756 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.442981 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.443077 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.443316 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.443411 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.443648 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.443742 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.443955 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.444243 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.444342 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.444611 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.444734 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.444960 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.445081 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.445307 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.445418 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.445647 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.445765 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.445966 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.446063 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.446284 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.446379 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.446615 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.446745 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.446938 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.447268 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.447590 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.447707 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.447909 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.448058 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.448232 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.448418 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.448629 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.448880 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.449040 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.449198 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.449378 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.449518 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.449790 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.449900 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.450112 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.450214 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.450428 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.450522 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.450749 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.450854 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.451067 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.451161 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.451391 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.451493 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.451718 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.451820 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.452041 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.452143 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.452362 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.452464 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.452703 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.452802 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.453017 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.453111 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.453330 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.453431 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.453641 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.453736 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.453957 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.454050 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.454275 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.454376 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.454586 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.454680 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.454892 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.455015 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.455234 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.455344 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.455548 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.455651 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.455920 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.456036 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.456243 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.456359 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.456576 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.456700 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.456972 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.457086 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.457241 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.457497 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.457593 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.457681 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.457842 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.457946 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.458156 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.458277 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.458484 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.458588 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.458802 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.458904 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.459140 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.459236 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.459458 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.459560 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.459764 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.460462 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.460644 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.460792 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.460944 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.461093 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.461237 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.461392 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.461540 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.461682 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.461831 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.461973 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.462113 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.462268 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.462413 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.462564 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.462713 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.462856 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.463044 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.463193 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.463333 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.463484 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.463626 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.463774 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.463927 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.464069 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.464219 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.464361 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.464561 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.464713 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.464866 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.465018 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.465159 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.465299 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.465452 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.465595 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.465750 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.465892 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.466040 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.466183 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.466416 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.466581 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.466788 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.466896 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.467124 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.467223 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.467310 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.467406 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.467509 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.467674 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.467782 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.467956 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.468059 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.468266 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.468369 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.468600 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.468712 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.468943 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.469045 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.469257 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.469362 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.469577 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.469673 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.469884 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.469980 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.470204 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.470300 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.470523 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.470618 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.470836 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.470939 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.471144 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.471243 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.471478 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.471582 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.471796 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.471974 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.472114 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.472454 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.472800 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.472967 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.473121 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.473277 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.473431 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.473577 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.473723 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.473867 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.474023 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.474183 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.474337 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.474484 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.474662 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.474816 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.474997 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.475151 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.475303 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.475493 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.476190 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.476354 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.476627 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.476779 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.476934 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.477079 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.477242 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.477387 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.477540 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.477761 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.477978 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.478107 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.478270 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.478399 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.478513 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.478633 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.478754 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.478876 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.479035 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.479198 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.479608 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.479780 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.479912 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.480109 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.480229 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.480437 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.480569 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.480867 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.480987 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.481196 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.481331 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.481634 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.481776 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.481892 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.482020 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.482175 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.482383 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.482489 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.482782 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.482881 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.483136 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.483232 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.483453 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.483549 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.483799 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.483893 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.484127 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.484234 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.484444 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.484563 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.484785 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.484882 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.485093 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.485198 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.485338 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 18 10:28:08.485434 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:28:08.485656 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 18 10:28:08.638246 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO dbcounter [None req-baac377d-5fab-4450-bfab-006d1893fa39 None None] Registered counter for database nova_api Jul 18 10:28:08.638893 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO dbcounter [None req-69c436be-5008-4e63-8530-88f88e7dc6f3 None None] Registered counter for database nova_api Jul 18 10:28:08.659327 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_db.sqlalchemy.engines [None req-baac377d-5fab-4450-bfab-006d1893fa39 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117879) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 18 10:28:08.660917 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_db.sqlalchemy.engines [None req-69c436be-5008-4e63-8530-88f88e7dc6f3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117880) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 18 10:28:08.666307 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG dbcounter [-] [117879] Writer thread running {{(pid=117879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 18 10:28:08.667761 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG dbcounter [-] [117880] Writer thread running {{(pid=117880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 18 10:28:08.723787 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.context [None req-baac377d-5fab-4450-bfab-006d1893fa39 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),5fde33fe-e6c7-4fec-b6f1-087885458693(cell1) {{(pid=117879) load_cells /opt/stack/nova/nova/context.py:464}} Jul 18 10:28:08.725171 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.context [None req-69c436be-5008-4e63-8530-88f88e7dc6f3 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),5fde33fe-e6c7-4fec-b6f1-087885458693(cell1) {{(pid=117880) load_cells /opt/stack/nova/nova/context.py:464}} Jul 18 10:28:08.727819 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-baac377d-5fab-4450-bfab-006d1893fa39 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:28:08.729609 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-69c436be-5008-4e63-8530-88f88e7dc6f3 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:28:08.729742 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-baac377d-5fab-4450-bfab-006d1893fa39 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:28:08.730524 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-baac377d-5fab-4450-bfab-006d1893fa39 None None] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:28:08.731183 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-69c436be-5008-4e63-8530-88f88e7dc6f3 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:28:08.731973 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-69c436be-5008-4e63-8530-88f88e7dc6f3 None None] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:28:08.732561 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-baac377d-5fab-4450-bfab-006d1893fa39 None None] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:28:08.733952 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-69c436be-5008-4e63-8530-88f88e7dc6f3 None None] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:28:08.734527 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO dbcounter [None req-baac377d-5fab-4450-bfab-006d1893fa39 None None] Registered counter for database nova_cell0 Jul 18 10:28:08.735902 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO dbcounter [None req-69c436be-5008-4e63-8530-88f88e7dc6f3 None None] Registered counter for database nova_cell0 Jul 18 10:28:08.738604 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO dbcounter [None req-baac377d-5fab-4450-bfab-006d1893fa39 None None] Registered counter for database nova_cell1 Jul 18 10:28:08.740153 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO dbcounter [None req-69c436be-5008-4e63-8530-88f88e7dc6f3 None None] Registered counter for database nova_cell1 Jul 18 10:28:08.747726 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_db.sqlalchemy.engines [None req-baac377d-5fab-4450-bfab-006d1893fa39 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117879) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 18 10:28:08.749669 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_db.sqlalchemy.engines [None req-69c436be-5008-4e63-8530-88f88e7dc6f3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117880) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 18 10:28:08.752580 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG dbcounter [-] [117879] Writer thread running {{(pid=117879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 18 10:28:08.752754 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_db.sqlalchemy.engines [None req-69c436be-5008-4e63-8530-88f88e7dc6f3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117880) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 18 10:28:08.753242 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_db.sqlalchemy.engines [None req-baac377d-5fab-4450-bfab-006d1893fa39 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117879) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 18 10:28:08.756293 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG dbcounter [-] [117880] Writer thread running {{(pid=117880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 18 10:28:08.893825 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG dbcounter [-] [117880] Writer thread running {{(pid=117880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 18 10:28:08.895076 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG dbcounter [-] [117879] Writer thread running {{(pid=117879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 18 10:28:08.904237 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO dbcounter [None req-69c436be-5008-4e63-8530-88f88e7dc6f3 None None] Registered counter for database nova_cell0 Jul 18 10:28:08.904375 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO dbcounter [None req-baac377d-5fab-4450-bfab-006d1893fa39 None None] Registered counter for database nova_cell0 Jul 18 10:28:08.911258 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_db.sqlalchemy.engines [None req-69c436be-5008-4e63-8530-88f88e7dc6f3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117880) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 18 10:28:08.912814 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_db.sqlalchemy.engines [None req-baac377d-5fab-4450-bfab-006d1893fa39 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117879) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 18 10:28:08.915974 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG dbcounter [-] [117880] Writer thread running {{(pid=117880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 18 10:28:08.917400 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG dbcounter [-] [117879] Writer thread running {{(pid=117879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 18 10:28:09.229606 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: WARNING keystonemiddleware.auth_token [None req-69c436be-5008-4e63-8530-88f88e7dc6f3 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 18 10:28:09.235460 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: WARNING keystonemiddleware.auth_token [None req-baac377d-5fab-4450-bfab-006d1893fa39 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 18 10:28:09.236756 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: WARNING keystonemiddleware.auth_token [None req-69c436be-5008-4e63-8530-88f88e7dc6f3 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 18 10:28:09.243498 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: WARNING keystonemiddleware.auth_token [None req-baac377d-5fab-4450-bfab-006d1893fa39 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 18 10:28:09.583476 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: WARNING keystonemiddleware.auth_token [None req-69c436be-5008-4e63-8530-88f88e7dc6f3 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 18 10:28:09.590122 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: WARNING keystonemiddleware.auth_token [None req-69c436be-5008-4e63-8530-88f88e7dc6f3 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 18 10:28:09.595372 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55cb8914f9c0 pid: 117880 (default app) Jul 18 10:28:09.598615 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: WARNING keystonemiddleware.auth_token [None req-baac377d-5fab-4450-bfab-006d1893fa39 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 18 10:28:09.605404 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: WARNING keystonemiddleware.auth_token [None req-baac377d-5fab-4450-bfab-006d1893fa39 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 18 10:28:09.610658 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55cb8914f9c0 pid: 117879 (default app) Jul 18 10:28:50.608403 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG dbcounter [-] [117880] Writing DB stats nova_api:SELECT=3 {{(pid=117880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:28:50.609644 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG dbcounter [-] [117880] Writing DB stats nova_cell0:SELECT=3 {{(pid=117880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:28:50.610430 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG dbcounter [-] [117880] Writing DB stats nova_cell1:SELECT=3 {{(pid=117880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:28:50.611196 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG dbcounter [-] [117880] Writing DB stats nova_cell0:SELECT=3 {{(pid=117880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:28:52.254732 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-f2368f4b-800e-4cb1-ae60-7faaaefc35ec tempest-VolumesSnapshotsTestJSON-1195547464 tempest-VolumesSnapshotsTestJSON-1195547464-project] Action: 'create', calling method: .version_select at 0x7f9f4c075820>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1956887675"}} {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:28:53.919471 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-f2368f4b-800e-4cb1-ae60-7faaaefc35ec tempest-VolumesSnapshotsTestJSON-1195547464 tempest-VolumesSnapshotsTestJSON-1195547464-project] 10.222.0.33 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 3.314900 Jul 18 10:28:53.920752 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 1/1] 10.222.0.33 () {60 vars in 1154 bytes} [Mon Jul 18 10:28:50 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 3320 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Jul 18 10:28:54.322618 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-75f1d3bb-95ea-40f4-b8df-b4517ff69c88 tempest-VolumesSnapshotsTestJSON-1195547464 tempest-VolumesSnapshotsTestJSON-1195547464-project] Calling method '.version_select at 0x7f9f4c1a93a0>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:28:54.366838 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG dbcounter [-] [117879] Writing DB stats nova_api:SELECT=3 {{(pid=117879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:28:54.368463 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG dbcounter [-] [117879] Writing DB stats nova_cell0:SELECT=3 {{(pid=117879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:28:54.369842 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG dbcounter [-] [117879] Writing DB stats nova_cell1:SELECT=3 {{(pid=117879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:28:54.370946 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG dbcounter [-] [117879] Writing DB stats nova_cell0:SELECT=3 {{(pid=117879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:28:54.742129 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-75f1d3bb-95ea-40f4-b8df-b4517ff69c88 tempest-VolumesSnapshotsTestJSON-1195547464 tempest-VolumesSnapshotsTestJSON-1195547464-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/77133285-5d30-43db-abc0-558b5fabd9a1" status: 200 len: 345 microversion: 2.1 time: 0.812485 Jul 18 10:28:54.743314 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 1/2] 10.222.0.33 () {58 vars in 1244 bytes} [Mon Jul 18 10:28:53 2022] GET /compute/v2.1/os-volumes/77133285-5d30-43db-abc0-558b5fabd9a1 => generated 345 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:28:55.754973 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-c936f755-fc12-4c9e-8702-97c667767db1 tempest-VolumesSnapshotsTestJSON-1195547464 tempest-VolumesSnapshotsTestJSON-1195547464-project] Calling method '.version_select at 0x7f9f4bf41670>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:28:55.864061 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-c936f755-fc12-4c9e-8702-97c667767db1 tempest-VolumesSnapshotsTestJSON-1195547464 tempest-VolumesSnapshotsTestJSON-1195547464-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/77133285-5d30-43db-abc0-558b5fabd9a1" status: 200 len: 346 microversion: 2.1 time: 0.113153 Jul 18 10:28:55.865522 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 2/3] 10.222.0.33 () {58 vars in 1244 bytes} [Mon Jul 18 10:28:55 2022] GET /compute/v2.1/os-volumes/77133285-5d30-43db-abc0-558b5fabd9a1 => generated 346 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:28:55.878437 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-35162768-545e-4272-87eb-144ffbf693e8 tempest-VolumesSnapshotsTestJSON-1195547464 tempest-VolumesSnapshotsTestJSON-1195547464-project] Action: 'create', calling method: .version_select at 0x7f9f4bf82670>, body: {"snapshot": {"volume_id": "77133285-5d30-43db-abc0-558b5fabd9a1", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-937351144"}} {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:28:56.305793 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-35162768-545e-4272-87eb-144ffbf693e8 tempest-VolumesSnapshotsTestJSON-1195547464 tempest-VolumesSnapshotsTestJSON-1195547464-project] 10.222.0.33 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.431679 Jul 18 10:28:56.306532 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 2/4] 10.222.0.33 () {60 vars in 1161 bytes} [Mon Jul 18 10:28:55 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:28:56.320294 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-9866caaf-1dfb-4f96-bf04-6781234e3031 tempest-VolumesSnapshotsTestJSON-1195547464 tempest-VolumesSnapshotsTestJSON-1195547464-project] Calling method '.version_select at 0x7f9f4bf419d0>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:28:56.383288 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-9866caaf-1dfb-4f96-bf04-6781234e3031 tempest-VolumesSnapshotsTestJSON-1195547464 tempest-VolumesSnapshotsTestJSON-1195547464-project] 10.222.0.33 "GET /compute/v2.1/os-snapshots/d960774a-4e4d-478a-a2ec-27459693d59c" status: 200 len: 286 microversion: 2.1 time: 0.070370 Jul 18 10:28:56.383859 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 3/5] 10.222.0.33 () {58 vars in 1250 bytes} [Mon Jul 18 10:28:56 2022] GET /compute/v2.1/os-snapshots/d960774a-4e4d-478a-a2ec-27459693d59c => generated 286 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:28:56.397580 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-c8fb24d8-9939-4439-8e8a-48a69dcb9e2d tempest-VolumesSnapshotsTestJSON-1195547464 tempest-VolumesSnapshotsTestJSON-1195547464-project] Calling method '.version_select at 0x7f9f4bf82e50>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:28:56.481302 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-c8fb24d8-9939-4439-8e8a-48a69dcb9e2d tempest-VolumesSnapshotsTestJSON-1195547464 tempest-VolumesSnapshotsTestJSON-1195547464-project] 10.222.0.33 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.089546 Jul 18 10:28:56.488845 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 3/6] 10.222.0.33 () {58 vars in 1139 bytes} [Mon Jul 18 10:28:56 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:28:56.492436 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-3484a2a4-295a-41f9-a5b9-01f8c0fe787e tempest-VolumesSnapshotsTestJSON-1195547464 tempest-VolumesSnapshotsTestJSON-1195547464-project] Calling method '.version_select at 0x7f9f4bf41e50>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:28:56.561986 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-3484a2a4-295a-41f9-a5b9-01f8c0fe787e tempest-VolumesSnapshotsTestJSON-1195547464 tempest-VolumesSnapshotsTestJSON-1195547464-project] 10.222.0.33 "GET /compute/v2.1/os-snapshots/d960774a-4e4d-478a-a2ec-27459693d59c" status: 200 len: 286 microversion: 2.1 time: 0.072167 Jul 18 10:28:56.563881 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 4/7] 10.222.0.33 () {58 vars in 1250 bytes} [Mon Jul 18 10:28:56 2022] GET /compute/v2.1/os-snapshots/d960774a-4e4d-478a-a2ec-27459693d59c => generated 286 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:28:57.575571 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-b5f34d37-0580-4227-8b7c-5b359d2e62ad tempest-VolumesSnapshotsTestJSON-1195547464 tempest-VolumesSnapshotsTestJSON-1195547464-project] Calling method '.version_select at 0x7f9f4bf48b80>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:28:57.694511 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-b5f34d37-0580-4227-8b7c-5b359d2e62ad tempest-VolumesSnapshotsTestJSON-1195547464 tempest-VolumesSnapshotsTestJSON-1195547464-project] 10.222.0.33 "GET /compute/v2.1/os-snapshots/d960774a-4e4d-478a-a2ec-27459693d59c" status: 200 len: 286 microversion: 2.1 time: 0.123103 Jul 18 10:28:57.695306 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 4/8] 10.222.0.33 () {58 vars in 1250 bytes} [Mon Jul 18 10:28:57 2022] GET /compute/v2.1/os-snapshots/d960774a-4e4d-478a-a2ec-27459693d59c => generated 286 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:28:58.706894 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-fb0f011b-8df2-4611-a702-13405a0a1b56 tempest-VolumesSnapshotsTestJSON-1195547464 tempest-VolumesSnapshotsTestJSON-1195547464-project] Calling method '.version_select at 0x7f9f4bf59550>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:28:58.775148 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-fb0f011b-8df2-4611-a702-13405a0a1b56 tempest-VolumesSnapshotsTestJSON-1195547464 tempest-VolumesSnapshotsTestJSON-1195547464-project] 10.222.0.33 "GET /compute/v2.1/os-snapshots/d960774a-4e4d-478a-a2ec-27459693d59c" status: 200 len: 286 microversion: 2.1 time: 0.072056 Jul 18 10:28:58.775566 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 5/9] 10.222.0.33 () {58 vars in 1250 bytes} [Mon Jul 18 10:28:58 2022] GET /compute/v2.1/os-snapshots/d960774a-4e4d-478a-a2ec-27459693d59c => generated 286 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:28:59.787219 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-4162fd6d-04d1-44a3-8317-c8ebe2ddc11f tempest-VolumesSnapshotsTestJSON-1195547464 tempest-VolumesSnapshotsTestJSON-1195547464-project] Calling method '.version_select at 0x7f9f4bf48700>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:28:59.874668 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-4162fd6d-04d1-44a3-8317-c8ebe2ddc11f tempest-VolumesSnapshotsTestJSON-1195547464 tempest-VolumesSnapshotsTestJSON-1195547464-project] 10.222.0.33 "GET /compute/v2.1/os-snapshots/d960774a-4e4d-478a-a2ec-27459693d59c" status: 200 len: 286 microversion: 2.1 time: 0.092309 Jul 18 10:28:59.876130 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 5/10] 10.222.0.33 () {58 vars in 1250 bytes} [Mon Jul 18 10:28:59 2022] GET /compute/v2.1/os-snapshots/d960774a-4e4d-478a-a2ec-27459693d59c => generated 286 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:29:00.891857 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-a7e1f1b9-0789-42b8-b108-0a6de2b536cb tempest-VolumesSnapshotsTestJSON-1195547464 tempest-VolumesSnapshotsTestJSON-1195547464-project] Calling method '.version_select at 0x7f9f4bf48160>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:29:00.955690 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-a7e1f1b9-0789-42b8-b108-0a6de2b536cb tempest-VolumesSnapshotsTestJSON-1195547464 tempest-VolumesSnapshotsTestJSON-1195547464-project] 10.222.0.33 "GET /compute/v2.1/os-snapshots/d960774a-4e4d-478a-a2ec-27459693d59c" status: 200 len: 286 microversion: 2.1 time: 0.071979 Jul 18 10:29:00.956471 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 6/11] 10.222.0.33 () {58 vars in 1250 bytes} [Mon Jul 18 10:29:00 2022] GET /compute/v2.1/os-snapshots/d960774a-4e4d-478a-a2ec-27459693d59c => generated 286 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 10:29:01.182268 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-3d673d2f-9f92-4b85-a6af-0604f69ccf9a tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Action: 'create', calling method: .version_select at 0x7f9f4bf41dc0>, body: {"keypair": {"name": "tempest-keypair-681937332", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBme7jvt7hJTt/m2bntizQME85BXEnAnCcdBI1WUXuNvZhEvaE0MPPXADhUM7H+hBpaB6OIYbbX/ioFxU1/5YZTnGtti/M4Vduvyux2rCEzqsx+rcbH7FPp7sTr/p1AGjA=="}} {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:29:01.241470 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.quota [None req-3d673d2f-9f92-4b85-a6af-0604f69ccf9a tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Getting quotas for project 1cf3d5bfe9a745f38372c42c9cfa1f63. Resources: {'key_pairs'} {{(pid=117880) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 10:29:01.252475 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.quota [None req-3d673d2f-9f92-4b85-a6af-0604f69ccf9a tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Getting quotas for user f25c72896a2d4d619e5ad4b5a0a79aa6 and project 1cf3d5bfe9a745f38372c42c9cfa1f63. Resources: {'key_pairs'} {{(pid=117880) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 10:29:01.332712 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-3d673d2f-9f92-4b85-a6af-0604f69ccf9a tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.856642 Jul 18 10:29:01.334212 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 6/12] 10.222.0.33 () {60 vars in 1158 bytes} [Mon Jul 18 10:29:00 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:29:01.974577 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-9526d75f-97ee-4384-a6f4-3370645d1bb5 tempest-VolumesSnapshotsTestJSON-1195547464 tempest-VolumesSnapshotsTestJSON-1195547464-project] Calling method '.version_select at 0x7f9f4bf82e50>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:29:02.037140 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-9526d75f-97ee-4384-a6f4-3370645d1bb5 tempest-VolumesSnapshotsTestJSON-1195547464 tempest-VolumesSnapshotsTestJSON-1195547464-project] 10.222.0.33 "GET /compute/v2.1/os-snapshots/d960774a-4e4d-478a-a2ec-27459693d59c" status: 200 len: 287 microversion: 2.1 time: 0.072393 Jul 18 10:29:02.037541 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 7/13] 10.222.0.33 () {58 vars in 1250 bytes} [Mon Jul 18 10:29:01 2022] GET /compute/v2.1/os-snapshots/d960774a-4e4d-478a-a2ec-27459693d59c => generated 287 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:29:02.049029 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-9a73aab5-8458-4ea0-a695-bc05dee5c6c4 tempest-VolumesSnapshotsTestJSON-1195547464 tempest-VolumesSnapshotsTestJSON-1195547464-project] Calling method '.version_select at 0x7f9f4bf2aee0>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:29:02.197126 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-9a73aab5-8458-4ea0-a695-bc05dee5c6c4 tempest-VolumesSnapshotsTestJSON-1195547464 tempest-VolumesSnapshotsTestJSON-1195547464-project] 10.222.0.33 "DELETE /compute/v2.1/os-snapshots/d960774a-4e4d-478a-a2ec-27459693d59c" status: 202 len: 0 microversion: 2.1 time: 0.152319 Jul 18 10:29:02.200645 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 7/14] 10.222.0.33 () {58 vars in 1253 bytes} [Mon Jul 18 10:29:02 2022] DELETE /compute/v2.1/os-snapshots/d960774a-4e4d-478a-a2ec-27459693d59c => generated 0 bytes in 157 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 10:29:02.207320 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-5592d33e-a936-4b3a-8ac0-3a5946c16f46 tempest-VolumesSnapshotsTestJSON-1195547464 tempest-VolumesSnapshotsTestJSON-1195547464-project] Calling method '.version_select at 0x7f9f4bf591f0>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:29:02.267477 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-5592d33e-a936-4b3a-8ac0-3a5946c16f46 tempest-VolumesSnapshotsTestJSON-1195547464 tempest-VolumesSnapshotsTestJSON-1195547464-project] 10.222.0.33 "GET /compute/v2.1/os-snapshots/d960774a-4e4d-478a-a2ec-27459693d59c" status: 200 len: 286 microversion: 2.1 time: 0.063683 Jul 18 10:29:02.269349 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 8/15] 10.222.0.33 () {58 vars in 1250 bytes} [Mon Jul 18 10:29:02 2022] GET /compute/v2.1/os-snapshots/d960774a-4e4d-478a-a2ec-27459693d59c => generated 286 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:29:03.282406 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-d48e0dd7-fb1e-4a30-9e43-f45eee248ddf tempest-VolumesSnapshotsTestJSON-1195547464 tempest-VolumesSnapshotsTestJSON-1195547464-project] Calling method '.version_select at 0x7f9f4bee4550>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:29:03.352954 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-d48e0dd7-fb1e-4a30-9e43-f45eee248ddf tempest-VolumesSnapshotsTestJSON-1195547464 tempest-VolumesSnapshotsTestJSON-1195547464-project] 10.222.0.33 "GET /compute/v2.1/os-snapshots/d960774a-4e4d-478a-a2ec-27459693d59c" status: 200 len: 286 microversion: 2.1 time: 0.075518 Jul 18 10:29:03.354324 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 8/16] 10.222.0.33 () {58 vars in 1250 bytes} [Mon Jul 18 10:29:03 2022] GET /compute/v2.1/os-snapshots/d960774a-4e4d-478a-a2ec-27459693d59c => generated 286 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:29:04.366149 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-9447b1f2-6191-4665-9be6-9de888904470 tempest-VolumesSnapshotsTestJSON-1195547464 tempest-VolumesSnapshotsTestJSON-1195547464-project] Calling method '.version_select at 0x7f9f4c075820>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:29:04.434628 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-9447b1f2-6191-4665-9be6-9de888904470 tempest-VolumesSnapshotsTestJSON-1195547464 tempest-VolumesSnapshotsTestJSON-1195547464-project] 10.222.0.33 "GET /compute/v2.1/os-snapshots/d960774a-4e4d-478a-a2ec-27459693d59c" status: 200 len: 286 microversion: 2.1 time: 0.072757 Jul 18 10:29:04.435187 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 9/17] 10.222.0.33 () {58 vars in 1250 bytes} [Mon Jul 18 10:29:04 2022] GET /compute/v2.1/os-snapshots/d960774a-4e4d-478a-a2ec-27459693d59c => generated 286 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 10:29:04.575423 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-da3cdb92-7dcf-4914-97e0-199207cb5640 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1257972025", "imageRef": "2cb02169-9999-411b-8c74-f88c068960fc", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:29:04.927803 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.network.neutron [None req-da3cdb92-7dcf-4914-97e0-199207cb5640 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] validate_networks() for [('3122165b-a136-4d21-b84f-81ce161e0ad4', None, None, None, None, None)] {{(pid=117879) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 10:29:05.446944 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-9ca01e26-3a52-4aeb-b834-13bcff1b41dc tempest-VolumesSnapshotsTestJSON-1195547464 tempest-VolumesSnapshotsTestJSON-1195547464-project] Calling method '.version_select at 0x7f9f4bee4790>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:29:05.702037 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.wsgi [None req-9ca01e26-3a52-4aeb-b834-13bcff1b41dc tempest-VolumesSnapshotsTestJSON-1195547464 tempest-VolumesSnapshotsTestJSON-1195547464-project] HTTP exception thrown: Snapshot d960774a-4e4d-478a-a2ec-27459693d59c could not be found. Jul 18 10:29:05.731891 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-9ca01e26-3a52-4aeb-b834-13bcff1b41dc tempest-VolumesSnapshotsTestJSON-1195547464 tempest-VolumesSnapshotsTestJSON-1195547464-project] Request method failure captured: Jul 18 10:29:05.731891 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: request: GET /compute/v2.1/os-snapshots/d960774a-4e4d-478a-a2ec-27459693d59c HTTP/1.1 Jul 18 10:29:05.731891 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: Accept: application/json Jul 18 10:29:05.731891 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: Accept-Encoding: identity Jul 18 10:29:05.731891 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: Connection: close Jul 18 10:29:05.731891 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: Content-Length: 0 Jul 18 10:29:05.731891 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: Content-Type: application/json Jul 18 10:29:05.731891 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: Host: 10.222.0.33 Jul 18 10:29:05.731891 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: Openstack-System-Scope: None Jul 18 10:29:05.731891 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: User-Agent: python-urllib3/1.26.9 Jul 18 10:29:05.731891 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Auth-Token: gAAAAABi1TXixweqjqnyphbCvJ-bgx5GKZUAPPQn2CZgV8oQnf6sGBuzAqpODPoPcnqdGys70ARb57I0hn3hcrjtLao_H9-hFUQ5L6bIcAOUNIZLwURgTbWjCjINITKlTslONrAxIiOCDFYErZ3ILONwEZtjytVkRWqsbNjI4ILFn_RWOotPeiY Jul 18 10:29:05.731891 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Domain-Id: None Jul 18 10:29:05.731891 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Domain-Name: None Jul 18 10:29:05.731891 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Identity-Status: Confirmed Jul 18 10:29:05.731891 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Is-Admin-Project: True Jul 18 10:29:05.731891 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Project-Domain-Id: default Jul 18 10:29:05.731891 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Project-Domain-Name: Default Jul 18 10:29:05.731891 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Project-Id: 926f2ef83f424b9f830078de3486361f Jul 18 10:29:05.731891 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1195547464 Jul 18 10:29:05.731891 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Role: member,reader Jul 18 10:29:05.731891 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Roles: member,reader Jul 18 10:29:05.732990 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/926f2ef83f424b9f830078de3486361f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/926f2ef83f424b9f830078de3486361f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/926f2ef83f424b9f830078de3486361f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_926f2ef83f424b9f830078de3486361f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jul 18 10:29:05.732990 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1195547464 Jul 18 10:29:05.732990 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Tenant-Id: 926f2ef83f424b9f830078de3486361f Jul 18 10:29:05.732990 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1195547464 Jul 18 10:29:05.732990 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-User: tempest-VolumesSnapshotsTestJSON-1195547464-project Jul 18 10:29:05.732990 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-User-Domain-Id: default Jul 18 10:29:05.732990 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-User-Domain-Name: Default Jul 18 10:29:05.732990 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-User-Id: efcd904b529f44f1a7511d6d9009d40a Jul 18 10:29:05.732990 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1195547464-project Jul 18 10:29:05.732990 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: method: Jul 18 10:29:05.732990 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: exception: Snapshot d960774a-4e4d-478a-a2ec-27459693d59c could not be found. Jul 18 10:29:05.732990 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: action_args: {'id': 'd960774a-4e4d-478a-a2ec-27459693d59c'} Jul 18 10:29:05.732990 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 10:29:05.733737 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:29:05.733737 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 18 10:29:05.733737 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 18 10:29:05.733737 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 18 10:29:05.733737 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 18 10:29:05.733737 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 18 10:29:05.733737 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 18 10:29:05.733737 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 18 10:29:05.733737 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 18 10:29:05.733737 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 18 10:29:05.733737 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 18 10:29:05.733737 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 18 10:29:05.733737 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 18 10:29:05.733737 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 18 10:29:05.733737 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 18 10:29:05.733737 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot d960774a-4e4d-478a-a2ec-27459693d59c could not be found. (HTTP 404) (Request-ID: req-790ae2d2-bc7b-4737-aca1-7b2eaca91187) Jul 18 10:29:05.733737 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi Jul 18 10:29:05.733737 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:29:05.734579 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi Jul 18 10:29:05.734579 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:29:05.734579 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jul 18 10:29:05.734579 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jul 18 10:29:05.734579 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 18 10:29:05.734579 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 18 10:29:05.734579 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jul 18 10:29:05.734579 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jul 18 10:29:05.734579 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 18 10:29:05.734579 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 18 10:29:05.734579 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 18 10:29:05.734579 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 18 10:29:05.734579 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 18 10:29:05.734579 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 18 10:29:05.734579 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 18 10:29:05.734579 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 18 10:29:05.734579 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 18 10:29:05.734579 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 18 10:29:05.734579 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 18 10:29:05.735460 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 18 10:29:05.735460 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 18 10:29:05.735460 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 18 10:29:05.735460 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 18 10:29:05.735460 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 18 10:29:05.735460 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot d960774a-4e4d-478a-a2ec-27459693d59c could not be found. Jul 18 10:29:05.735460 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi Jul 18 10:29:05.735460 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:29:05.735460 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi Jul 18 10:29:05.735460 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:29:05.735460 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:29:05.735460 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:29:05.735460 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 10:29:05.735460 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 10:29:05.735460 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 10:29:05.735460 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 10:29:05.735460 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 10:29:05.735460 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 10:29:05.735460 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jul 18 10:29:05.735460 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 10:29:05.736403 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot d960774a-4e4d-478a-a2ec-27459693d59c could not be found. Jul 18 10:29:05.736403 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi Jul 18 10:29:05.736403 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:29:05.736403 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi Jul 18 10:29:05.736403 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:29:05.736403 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:29:05.736403 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:29:05.736403 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 10:29:05.736403 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 10:29:05.736403 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot d960774a-4e4d-478a-a2ec-27459693d59c could not be found. Jul 18 10:29:05.736403 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi Jul 18 10:29:05.744906 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-9ca01e26-3a52-4aeb-b834-13bcff1b41dc tempest-VolumesSnapshotsTestJSON-1195547464 tempest-VolumesSnapshotsTestJSON-1195547464-project] Returning 404 to user: Snapshot d960774a-4e4d-478a-a2ec-27459693d59c could not be found. {{(pid=117880) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 10:29:05.756523 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-9ca01e26-3a52-4aeb-b834-13bcff1b41dc tempest-VolumesSnapshotsTestJSON-1195547464 tempest-VolumesSnapshotsTestJSON-1195547464-project] 10.222.0.33 "GET /compute/v2.1/os-snapshots/d960774a-4e4d-478a-a2ec-27459693d59c" status: 404 len: 111 microversion: 2.1 time: 0.308348 Jul 18 10:29:05.764548 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 10/18] 10.222.0.33 () {58 vars in 1250 bytes} [Mon Jul 18 10:29:05 2022] GET /compute/v2.1/os-snapshots/d960774a-4e4d-478a-a2ec-27459693d59c => generated 111 bytes in 322 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 18 10:29:05.786948 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-1c446df1-e884-4b7c-9dc1-d69e0a9d8dc3 tempest-VolumesSnapshotsTestJSON-1195547464 tempest-VolumesSnapshotsTestJSON-1195547464-project] Calling method '.version_select at 0x7f9f4b64b3a0>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:29:06.179041 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-1c446df1-e884-4b7c-9dc1-d69e0a9d8dc3 tempest-VolumesSnapshotsTestJSON-1195547464 tempest-VolumesSnapshotsTestJSON-1195547464-project] 10.222.0.33 "DELETE /compute/v2.1/os-volumes/77133285-5d30-43db-abc0-558b5fabd9a1" status: 202 len: 0 microversion: 2.1 time: 0.408924 Jul 18 10:29:06.180223 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 11/19] 10.222.0.33 () {58 vars in 1247 bytes} [Mon Jul 18 10:29:05 2022] DELETE /compute/v2.1/os-volumes/77133285-5d30-43db-abc0-558b5fabd9a1 => generated 0 bytes in 412 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 10:29:06.197148 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-a59590c0-b269-4eb7-a236-78529bd793c3 tempest-VolumesSnapshotsTestJSON-1195547464 tempest-VolumesSnapshotsTestJSON-1195547464-project] Calling method '.version_select at 0x7f9f4b64ba60>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:29:06.332206 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-a59590c0-b269-4eb7-a236-78529bd793c3 tempest-VolumesSnapshotsTestJSON-1195547464 tempest-VolumesSnapshotsTestJSON-1195547464-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/77133285-5d30-43db-abc0-558b5fabd9a1" status: 200 len: 345 microversion: 2.1 time: 0.147071 Jul 18 10:29:06.333924 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 12/20] 10.222.0.33 () {58 vars in 1244 bytes} [Mon Jul 18 10:29:06 2022] GET /compute/v2.1/os-volumes/77133285-5d30-43db-abc0-558b5fabd9a1 => generated 345 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:29:06.580978 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.virt.hardware [None req-da3cdb92-7dcf-4914-97e0-199207cb5640 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Flavor limits 0:0:0 {{(pid=117879) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 10:29:06.581427 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.virt.hardware [None req-da3cdb92-7dcf-4914-97e0-199207cb5640 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Image limits 0:0:0 {{(pid=117879) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 10:29:06.581867 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.virt.hardware [None req-da3cdb92-7dcf-4914-97e0-199207cb5640 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Flavor pref 0:0:0 {{(pid=117879) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 10:29:06.582272 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.virt.hardware [None req-da3cdb92-7dcf-4914-97e0-199207cb5640 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Image pref 0:0:0 {{(pid=117879) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 10:29:06.583452 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.virt.hardware [None req-da3cdb92-7dcf-4914-97e0-199207cb5640 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117879) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 10:29:06.610897 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-da3cdb92-7dcf-4914-97e0-199207cb5640 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:29:06.611643 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-da3cdb92-7dcf-4914-97e0-199207cb5640 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:29:06.612648 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-da3cdb92-7dcf-4914-97e0-199207cb5640 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:29:06.619491 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-da3cdb92-7dcf-4914-97e0-199207cb5640 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:29:06.743783 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.quota [None req-da3cdb92-7dcf-4914-97e0-199207cb5640 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Getting quotas for project 8a1921237622439bab89676e11477c13. Resources: {'ram', 'cores', 'instances'} {{(pid=117879) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 10:29:06.767521 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.quota [None req-da3cdb92-7dcf-4914-97e0-199207cb5640 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Getting quotas for user 72a431c9708f4694bc0d514133e76088 and project 8a1921237622439bab89676e11477c13. Resources: {'ram', 'cores', 'instances'} {{(pid=117879) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 10:29:06.801442 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-da3cdb92-7dcf-4914-97e0-199207cb5640 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Going to run 1 instances... {{(pid=117879) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 10:29:06.814328 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-da3cdb92-7dcf-4914-97e0-199207cb5640 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] [instance: 591fab72-3729-4b6f-af75-cc55766b7eae] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2cb02169-9999-411b-8c74-f88c068960fc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117879) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 10:29:07.047896 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-da3cdb92-7dcf-4914-97e0-199207cb5640 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.762576 Jul 18 10:29:07.049783 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 9/21] 10.222.0.33 () {60 vars in 1146 bytes} [Mon Jul 18 10:29:04 2022] POST /compute/v2.1/servers => generated 383 bytes in 2781 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 10:29:07.062517 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-f13560ac-7bc4-4b93-81bd-b9fa3bebcc85 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:29:07.066580 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-f13560ac-7bc4-4b93-81bd-b9fa3bebcc85 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] [instance: 591fab72-3729-4b6f-af75-cc55766b7eae] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:29:07.211712 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-71a85b1f-358f-4d35-9416-586b5da346c3 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Action: 'create', calling method: .version_select at 0x7f9f4b6520d0>, body: {"keypair": {"name": "tempest-keypair-948735427", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI9cdZwlI+7/+rs+eR7Gwu2I0tPkFWbpcBjMpCXxJ4Nly+SPvhCDDRwg8lZqfKI1DtnZSh2ROCoP8cQnR9rY1QbkjmrWI4ND6L7uCCFRbokCUTdodZiaeWg5RkAmG82VsQ=="}} {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:29:07.258396 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.quota [None req-71a85b1f-358f-4d35-9416-586b5da346c3 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Getting quotas for project e6e487deb7ff45bdbf2cc002d42d12a5. Resources: {'key_pairs'} {{(pid=117880) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 10:29:07.264842 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.quota [None req-71a85b1f-358f-4d35-9416-586b5da346c3 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Getting quotas for user 986f90dfbad14324b3fffbd790d60a37 and project e6e487deb7ff45bdbf2cc002d42d12a5. Resources: {'key_pairs'} {{(pid=117880) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 10:29:07.299266 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-f13560ac-7bc4-4b93-81bd-b9fa3bebcc85 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a431c9708f4694bc0d514133e76088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a1921237622439bab89676e11477c13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:29:07.323263 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-f13560ac-7bc4-4b93-81bd-b9fa3bebcc85 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] 10.222.0.33 "GET /compute/v2.1/servers/591fab72-3729-4b6f-af75-cc55766b7eae" status: 200 len: 1222 microversion: 2.1 time: 0.265894 Jul 18 10:29:07.325556 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 10/22] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:29:07 2022] GET /compute/v2.1/servers/591fab72-3729-4b6f-af75-cc55766b7eae => generated 1222 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:29:07.346047 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-fa6deb44-a3f1-44e9-9c5d-a246567585ca tempest-VolumesSnapshotsTestJSON-1195547464 tempest-VolumesSnapshotsTestJSON-1195547464-project] Calling method '.version_select at 0x7f9f4adecf70>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:29:07.350716 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-71a85b1f-358f-4d35-9416-586b5da346c3 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.304159 Jul 18 10:29:07.355101 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 13/23] 10.222.0.33 () {60 vars in 1158 bytes} [Mon Jul 18 10:29:07 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 10:29:07.507241 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-fa6deb44-a3f1-44e9-9c5d-a246567585ca tempest-VolumesSnapshotsTestJSON-1195547464 tempest-VolumesSnapshotsTestJSON-1195547464-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/77133285-5d30-43db-abc0-558b5fabd9a1" status: 200 len: 345 microversion: 2.1 time: 0.165003 Jul 18 10:29:07.507940 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 11/24] 10.222.0.33 () {58 vars in 1244 bytes} [Mon Jul 18 10:29:07 2022] GET /compute/v2.1/os-volumes/77133285-5d30-43db-abc0-558b5fabd9a1 => generated 345 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:29:07.821595 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-d16e64ac-46db-4ca7-8f93-52720d1bfbe5 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-202891527", "imageRef": "2cb02169-9999-411b-8c74-f88c068960fc", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:29:07.987365 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.network.neutron [None req-d16e64ac-46db-4ca7-8f93-52720d1bfbe5 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] validate_networks() for [('3122165b-a136-4d21-b84f-81ce161e0ad4', None, None, None, None, None)] {{(pid=117880) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 10:29:08.520489 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-fc53ac09-8379-4fba-a622-8244746d3bec tempest-VolumesSnapshotsTestJSON-1195547464 tempest-VolumesSnapshotsTestJSON-1195547464-project] Calling method '.version_select at 0x7f9f4ae09b80>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:29:08.636984 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-fc53ac09-8379-4fba-a622-8244746d3bec tempest-VolumesSnapshotsTestJSON-1195547464 tempest-VolumesSnapshotsTestJSON-1195547464-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/77133285-5d30-43db-abc0-558b5fabd9a1" status: 200 len: 345 microversion: 2.1 time: 0.120595 Jul 18 10:29:08.638192 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 12/25] 10.222.0.33 () {58 vars in 1244 bytes} [Mon Jul 18 10:29:08 2022] GET /compute/v2.1/os-volumes/77133285-5d30-43db-abc0-558b5fabd9a1 => generated 345 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:29:08.644997 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-0e516f91-a601-4d92-bc18-5df0112f51f2 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-988071013", "imageRef": "2cb02169-9999-411b-8c74-f88c068960fc", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a8d66173-a1e2-46af-a5dc-6e62a2d0a4e4"}], "security_groups": [{"name": "tempest-securitygroup--1347093899"}], "key_name": "tempest-keypair-681937332", "user_data": "}} {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:29:09.021083 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.network.neutron [None req-0e516f91-a601-4d92-bc18-5df0112f51f2 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] validate_networks() for [('a8d66173-a1e2-46af-a5dc-6e62a2d0a4e4', None, None, None, None, None)] {{(pid=117879) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 10:29:10.030980 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.virt.hardware [None req-d16e64ac-46db-4ca7-8f93-52720d1bfbe5 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Flavor limits 0:0:0 {{(pid=117880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 10:29:10.032102 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.virt.hardware [None req-d16e64ac-46db-4ca7-8f93-52720d1bfbe5 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Image limits 0:0:0 {{(pid=117880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 10:29:10.032771 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.virt.hardware [None req-d16e64ac-46db-4ca7-8f93-52720d1bfbe5 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Flavor pref 0:0:0 {{(pid=117880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 10:29:10.033316 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.virt.hardware [None req-d16e64ac-46db-4ca7-8f93-52720d1bfbe5 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Image pref 0:0:0 {{(pid=117880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 10:29:10.033877 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.virt.hardware [None req-d16e64ac-46db-4ca7-8f93-52720d1bfbe5 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 10:29:10.054834 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-d16e64ac-46db-4ca7-8f93-52720d1bfbe5 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:29:10.055557 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-d16e64ac-46db-4ca7-8f93-52720d1bfbe5 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:29:10.059260 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-d16e64ac-46db-4ca7-8f93-52720d1bfbe5 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:29:10.060880 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-d16e64ac-46db-4ca7-8f93-52720d1bfbe5 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:29:10.101114 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.quota [None req-d16e64ac-46db-4ca7-8f93-52720d1bfbe5 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Getting quotas for project 8a1921237622439bab89676e11477c13. Resources: {'ram', 'cores', 'instances'} {{(pid=117880) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 10:29:10.107308 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.quota [None req-d16e64ac-46db-4ca7-8f93-52720d1bfbe5 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Getting quotas for user 72a431c9708f4694bc0d514133e76088 and project 8a1921237622439bab89676e11477c13. Resources: {'ram', 'cores', 'instances'} {{(pid=117880) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 10:29:10.124121 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-d16e64ac-46db-4ca7-8f93-52720d1bfbe5 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Going to run 1 instances... {{(pid=117880) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 10:29:10.127708 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-d16e64ac-46db-4ca7-8f93-52720d1bfbe5 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] [instance: 78bb7f95-9846-4a59-9f77-a3fe69005eec] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2cb02169-9999-411b-8c74-f88c068960fc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117880) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 10:29:10.218048 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.virt.hardware [None req-0e516f91-a601-4d92-bc18-5df0112f51f2 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Flavor limits 0:0:0 {{(pid=117879) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 10:29:10.218714 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.virt.hardware [None req-0e516f91-a601-4d92-bc18-5df0112f51f2 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Image limits 0:0:0 {{(pid=117879) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 10:29:10.219185 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.virt.hardware [None req-0e516f91-a601-4d92-bc18-5df0112f51f2 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Flavor pref 0:0:0 {{(pid=117879) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 10:29:10.219775 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.virt.hardware [None req-0e516f91-a601-4d92-bc18-5df0112f51f2 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Image pref 0:0:0 {{(pid=117879) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 10:29:10.220344 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.virt.hardware [None req-0e516f91-a601-4d92-bc18-5df0112f51f2 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117879) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 10:29:10.240774 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-0e516f91-a601-4d92-bc18-5df0112f51f2 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:29:10.246488 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-0e516f91-a601-4d92-bc18-5df0112f51f2 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:29:10.247499 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-0e516f91-a601-4d92-bc18-5df0112f51f2 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:29:10.247912 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-0e516f91-a601-4d92-bc18-5df0112f51f2 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:29:10.267454 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-d16e64ac-46db-4ca7-8f93-52720d1bfbe5 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.451551 Jul 18 10:29:10.274070 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 14/26] 10.222.0.33 () {60 vars in 1146 bytes} [Mon Jul 18 10:29:07 2022] POST /compute/v2.1/servers => generated 383 bytes in 2459 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 10:29:10.281178 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-2b0482b5-c185-432e-9a19-4295976f7d09 tempest-VolumesSnapshotsTestJSON-1195547464 tempest-VolumesSnapshotsTestJSON-1195547464-project] Calling method '.version_select at 0x7f9f4b56c940>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:29:10.304995 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.quota [None req-0e516f91-a601-4d92-bc18-5df0112f51f2 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Getting quotas for project 1cf3d5bfe9a745f38372c42c9cfa1f63. Resources: {'ram', 'cores', 'instances'} {{(pid=117879) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 10:29:10.322414 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.quota [None req-0e516f91-a601-4d92-bc18-5df0112f51f2 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Getting quotas for user f25c72896a2d4d619e5ad4b5a0a79aa6 and project 1cf3d5bfe9a745f38372c42c9cfa1f63. Resources: {'ram', 'cores', 'instances'} {{(pid=117879) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 10:29:10.366379 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-0e516f91-a601-4d92-bc18-5df0112f51f2 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Going to run 1 instances... {{(pid=117879) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 10:29:10.368733 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-0e516f91-a601-4d92-bc18-5df0112f51f2 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] [instance: db62c05e-28a8-4121-a6e5-8abb802f7a17] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2cb02169-9999-411b-8c74-f88c068960fc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117879) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 10:29:10.417170 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-2b0482b5-c185-432e-9a19-4295976f7d09 tempest-VolumesSnapshotsTestJSON-1195547464 tempest-VolumesSnapshotsTestJSON-1195547464-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/77133285-5d30-43db-abc0-558b5fabd9a1" status: 200 len: 345 microversion: 2.1 time: 0.140532 Jul 18 10:29:10.429741 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 15/27] 10.222.0.33 () {58 vars in 1244 bytes} [Mon Jul 18 10:29:10 2022] GET /compute/v2.1/os-volumes/77133285-5d30-43db-abc0-558b5fabd9a1 => generated 345 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:29:10.503587 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-0e516f91-a601-4d92-bc18-5df0112f51f2 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.863998 Jul 18 10:29:10.505055 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 13/28] 10.222.0.33 () {60 vars in 1146 bytes} [Mon Jul 18 10:29:08 2022] POST /compute/v2.1/servers => generated 402 bytes in 1866 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 10:29:10.513071 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-d2525d77-c1a8-4d89-a87a-77ade48292fe tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:29:10.514100 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-d2525d77-c1a8-4d89-a87a-77ade48292fe tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] [instance: 78bb7f95-9846-4a59-9f77-a3fe69005eec] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:29:10.669319 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-d2525d77-c1a8-4d89-a87a-77ade48292fe tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a431c9708f4694bc0d514133e76088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a1921237622439bab89676e11477c13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:29:10.686641 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-d2525d77-c1a8-4d89-a87a-77ade48292fe tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] 10.222.0.33 "GET /compute/v2.1/servers/78bb7f95-9846-4a59-9f77-a3fe69005eec" status: 200 len: 1221 microversion: 2.1 time: 0.180275 Jul 18 10:29:10.687234 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 14/29] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:29:10 2022] GET /compute/v2.1/servers/78bb7f95-9846-4a59-9f77-a3fe69005eec => generated 1221 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:29:10.699254 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-1ab2479d-6010-4d63-a17e-19ff4d916ce4 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:29:10.700710 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-1ab2479d-6010-4d63-a17e-19ff4d916ce4 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] [instance: db62c05e-28a8-4121-a6e5-8abb802f7a17] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:29:10.837251 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-1ab2479d-6010-4d63-a17e-19ff4d916ce4 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f25c72896a2d4d619e5ad4b5a0a79aa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cf3d5bfe9a745f38372c42c9cfa1f63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:29:10.848607 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-1ab2479d-6010-4d63-a17e-19ff4d916ce4 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] 10.222.0.33 "GET /compute/v2.1/servers/db62c05e-28a8-4121-a6e5-8abb802f7a17" status: 200 len: 1240 microversion: 2.1 time: 0.156143 Jul 18 10:29:10.860953 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 15/30] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:29:10 2022] GET /compute/v2.1/servers/db62c05e-28a8-4121-a6e5-8abb802f7a17 => generated 1240 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:29:11.121915 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-6f8d5737-47bc-4daf-8f8c-bde0949f38c8 tempest-DeleteServersTestJSON-1052419078 tempest-DeleteServersTestJSON-1052419078-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1729936832", "imageRef": "2cb02169-9999-411b-8c74-f88c068960fc", "flavorRef": "452", "networks": [{"uuid": "a825217e-675b-4d91-a035-cfdee7f60003"}]}} {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:29:11.256934 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.network.neutron [None req-6f8d5737-47bc-4daf-8f8c-bde0949f38c8 tempest-DeleteServersTestJSON-1052419078 tempest-DeleteServersTestJSON-1052419078-project] validate_networks() for [('a825217e-675b-4d91-a035-cfdee7f60003', None, None, None, None, None)] {{(pid=117880) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 10:29:11.284837 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-26a19d5f-dcde-4e3c-bca0-e8ec9b5f5b91 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-980081434", "imageRef": "2cb02169-9999-411b-8c74-f88c068960fc", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4fd50c95-7888-4b58-b176-0e3d534d461f"}], "security_groups": [{"name": "tempest-securitygroup--883296808"}], "key_name": "tempest-keypair-948735427", "user_data": "}} {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:29:11.549755 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.network.neutron [None req-26a19d5f-dcde-4e3c-bca0-e8ec9b5f5b91 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] validate_networks() for [('4fd50c95-7888-4b58-b176-0e3d534d461f', None, None, None, None, None)] {{(pid=117879) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 10:29:12.182118 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.virt.hardware [None req-6f8d5737-47bc-4daf-8f8c-bde0949f38c8 tempest-DeleteServersTestJSON-1052419078 tempest-DeleteServersTestJSON-1052419078-project] Flavor limits 0:0:0 {{(pid=117880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 10:29:12.182643 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.virt.hardware [None req-6f8d5737-47bc-4daf-8f8c-bde0949f38c8 tempest-DeleteServersTestJSON-1052419078 tempest-DeleteServersTestJSON-1052419078-project] Image limits 0:0:0 {{(pid=117880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 10:29:12.183011 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.virt.hardware [None req-6f8d5737-47bc-4daf-8f8c-bde0949f38c8 tempest-DeleteServersTestJSON-1052419078 tempest-DeleteServersTestJSON-1052419078-project] Flavor pref 0:0:0 {{(pid=117880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 10:29:12.183656 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.virt.hardware [None req-6f8d5737-47bc-4daf-8f8c-bde0949f38c8 tempest-DeleteServersTestJSON-1052419078 tempest-DeleteServersTestJSON-1052419078-project] Image pref 0:0:0 {{(pid=117880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 10:29:12.184151 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.virt.hardware [None req-6f8d5737-47bc-4daf-8f8c-bde0949f38c8 tempest-DeleteServersTestJSON-1052419078 tempest-DeleteServersTestJSON-1052419078-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 10:29:12.201344 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-6f8d5737-47bc-4daf-8f8c-bde0949f38c8 tempest-DeleteServersTestJSON-1052419078 tempest-DeleteServersTestJSON-1052419078-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:29:12.201820 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-6f8d5737-47bc-4daf-8f8c-bde0949f38c8 tempest-DeleteServersTestJSON-1052419078 tempest-DeleteServersTestJSON-1052419078-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:29:12.202868 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-6f8d5737-47bc-4daf-8f8c-bde0949f38c8 tempest-DeleteServersTestJSON-1052419078 tempest-DeleteServersTestJSON-1052419078-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:29:12.208739 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-6f8d5737-47bc-4daf-8f8c-bde0949f38c8 tempest-DeleteServersTestJSON-1052419078 tempest-DeleteServersTestJSON-1052419078-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:29:12.254279 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.quota [None req-6f8d5737-47bc-4daf-8f8c-bde0949f38c8 tempest-DeleteServersTestJSON-1052419078 tempest-DeleteServersTestJSON-1052419078-project] Getting quotas for project daab623e57e54081b262d4a8fe124f42. Resources: {'ram', 'cores', 'instances'} {{(pid=117880) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 10:29:12.269771 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.quota [None req-6f8d5737-47bc-4daf-8f8c-bde0949f38c8 tempest-DeleteServersTestJSON-1052419078 tempest-DeleteServersTestJSON-1052419078-project] Getting quotas for user c0f993e44c624f65abae22540ce7dffc and project daab623e57e54081b262d4a8fe124f42. Resources: {'ram', 'cores', 'instances'} {{(pid=117880) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 10:29:12.293631 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-6f8d5737-47bc-4daf-8f8c-bde0949f38c8 tempest-DeleteServersTestJSON-1052419078 tempest-DeleteServersTestJSON-1052419078-project] Going to run 1 instances... {{(pid=117880) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 10:29:12.299254 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-6f8d5737-47bc-4daf-8f8c-bde0949f38c8 tempest-DeleteServersTestJSON-1052419078 tempest-DeleteServersTestJSON-1052419078-project] [instance: df938010-ebc5-429f-8499-4b55eff7cab9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2cb02169-9999-411b-8c74-f88c068960fc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117880) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 10:29:12.409888 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-6f8d5737-47bc-4daf-8f8c-bde0949f38c8 tempest-DeleteServersTestJSON-1052419078 tempest-DeleteServersTestJSON-1052419078-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.976046 Jul 18 10:29:12.413413 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 16/31] 10.222.0.33 () {60 vars in 1146 bytes} [Mon Jul 18 10:29:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 1983 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 10:29:12.428535 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-98eefceb-d271-4217-9dfa-ffdd72600fd7 tempest-VolumesSnapshotsTestJSON-1195547464 tempest-VolumesSnapshotsTestJSON-1195547464-project] Calling method '.version_select at 0x7f9f4b5841f0>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:29:12.610624 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-98eefceb-d271-4217-9dfa-ffdd72600fd7 tempest-VolumesSnapshotsTestJSON-1195547464 tempest-VolumesSnapshotsTestJSON-1195547464-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/77133285-5d30-43db-abc0-558b5fabd9a1" status: 200 len: 345 microversion: 2.1 time: 0.194723 Jul 18 10:29:12.611464 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 17/32] 10.222.0.33 () {58 vars in 1244 bytes} [Mon Jul 18 10:29:12 2022] GET /compute/v2.1/os-volumes/77133285-5d30-43db-abc0-558b5fabd9a1 => generated 345 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:29:12.620255 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-c42791aa-0b3a-4560-9b38-fe42b965de74 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:29:12.621450 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-c42791aa-0b3a-4560-9b38-fe42b965de74 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] [instance: 78bb7f95-9846-4a59-9f77-a3fe69005eec] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:29:12.661684 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-c42791aa-0b3a-4560-9b38-fe42b965de74 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:29:12.665037 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-c42791aa-0b3a-4560-9b38-fe42b965de74 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:29:12.667649 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-c42791aa-0b3a-4560-9b38-fe42b965de74 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:29:12.669678 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-c42791aa-0b3a-4560-9b38-fe42b965de74 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:29:12.759575 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.virt.hardware [None req-26a19d5f-dcde-4e3c-bca0-e8ec9b5f5b91 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Flavor limits 0:0:0 {{(pid=117879) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 10:29:12.760174 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.virt.hardware [None req-26a19d5f-dcde-4e3c-bca0-e8ec9b5f5b91 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Image limits 0:0:0 {{(pid=117879) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 10:29:12.761020 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.virt.hardware [None req-26a19d5f-dcde-4e3c-bca0-e8ec9b5f5b91 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Flavor pref 0:0:0 {{(pid=117879) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 10:29:12.762244 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.virt.hardware [None req-26a19d5f-dcde-4e3c-bca0-e8ec9b5f5b91 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Image pref 0:0:0 {{(pid=117879) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 10:29:12.763248 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.virt.hardware [None req-26a19d5f-dcde-4e3c-bca0-e8ec9b5f5b91 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117879) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 10:29:12.809140 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-26a19d5f-dcde-4e3c-bca0-e8ec9b5f5b91 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:29:12.810366 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-26a19d5f-dcde-4e3c-bca0-e8ec9b5f5b91 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:29:12.811643 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-26a19d5f-dcde-4e3c-bca0-e8ec9b5f5b91 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:29:12.812548 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-26a19d5f-dcde-4e3c-bca0-e8ec9b5f5b91 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:29:12.865363 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.quota [None req-26a19d5f-dcde-4e3c-bca0-e8ec9b5f5b91 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Getting quotas for project e6e487deb7ff45bdbf2cc002d42d12a5. Resources: {'ram', 'cores', 'instances'} {{(pid=117879) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 10:29:12.874165 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.quota [None req-26a19d5f-dcde-4e3c-bca0-e8ec9b5f5b91 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Getting quotas for user 986f90dfbad14324b3fffbd790d60a37 and project e6e487deb7ff45bdbf2cc002d42d12a5. Resources: {'ram', 'cores', 'instances'} {{(pid=117879) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 10:29:12.900060 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-26a19d5f-dcde-4e3c-bca0-e8ec9b5f5b91 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Going to run 1 instances... {{(pid=117879) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 10:29:12.905409 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-26a19d5f-dcde-4e3c-bca0-e8ec9b5f5b91 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] [instance: dcb1b50b-9e62-4ff3-9875-3d4635597b45] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2cb02169-9999-411b-8c74-f88c068960fc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117879) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 10:29:13.061466 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-c42791aa-0b3a-4560-9b38-fe42b965de74 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a431c9708f4694bc0d514133e76088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a1921237622439bab89676e11477c13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:29:13.081774 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-c42791aa-0b3a-4560-9b38-fe42b965de74 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] 10.222.0.33 "GET /compute/v2.1/servers/78bb7f95-9846-4a59-9f77-a3fe69005eec" status: 200 len: 1225 microversion: 2.1 time: 0.469016 Jul 18 10:29:13.083118 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 18/33] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:29:12 2022] GET /compute/v2.1/servers/78bb7f95-9846-4a59-9f77-a3fe69005eec => generated 1225 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:29:13.088107 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-257191d1-a02f-466d-ae45-b818d738334a tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:29:13.089050 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-257191d1-a02f-466d-ae45-b818d738334a tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] [instance: db62c05e-28a8-4121-a6e5-8abb802f7a17] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:29:13.115129 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-26a19d5f-dcde-4e3c-bca0-e8ec9b5f5b91 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.832766 Jul 18 10:29:13.117397 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 16/34] 10.222.0.33 () {60 vars in 1146 bytes} [Mon Jul 18 10:29:11 2022] POST /compute/v2.1/servers => generated 401 bytes in 1838 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 10:29:13.127248 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-257191d1-a02f-466d-ae45-b818d738334a tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:29:13.129763 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-169feb65-067c-4345-beba-765cd49ec57b tempest-DeleteServersTestJSON-1052419078 tempest-DeleteServersTestJSON-1052419078-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:29:13.133181 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-257191d1-a02f-466d-ae45-b818d738334a tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:29:13.136156 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-169feb65-067c-4345-beba-765cd49ec57b tempest-DeleteServersTestJSON-1052419078 tempest-DeleteServersTestJSON-1052419078-project] [instance: df938010-ebc5-429f-8499-4b55eff7cab9] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:29:13.149674 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-257191d1-a02f-466d-ae45-b818d738334a tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:29:13.154970 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-257191d1-a02f-466d-ae45-b818d738334a tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:29:13.347935 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-169feb65-067c-4345-beba-765cd49ec57b tempest-DeleteServersTestJSON-1052419078 tempest-DeleteServersTestJSON-1052419078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0f993e44c624f65abae22540ce7dffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daab623e57e54081b262d4a8fe124f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:29:13.359795 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-169feb65-067c-4345-beba-765cd49ec57b tempest-DeleteServersTestJSON-1052419078 tempest-DeleteServersTestJSON-1052419078-project] 10.222.0.33 "GET /compute/v2.1/servers/df938010-ebc5-429f-8499-4b55eff7cab9" status: 200 len: 1215 microversion: 2.1 time: 0.241063 Jul 18 10:29:13.360392 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 17/35] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:29:13 2022] GET /compute/v2.1/servers/df938010-ebc5-429f-8499-4b55eff7cab9 => generated 1215 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:29:13.387202 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-f286176f-0ec3-43f9-85d2-9eaaf5f7f9da tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:29:13.388033 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-f286176f-0ec3-43f9-85d2-9eaaf5f7f9da tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] [instance: dcb1b50b-9e62-4ff3-9875-3d4635597b45] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:29:13.494766 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-257191d1-a02f-466d-ae45-b818d738334a tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f25c72896a2d4d619e5ad4b5a0a79aa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cf3d5bfe9a745f38372c42c9cfa1f63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:29:13.510213 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-257191d1-a02f-466d-ae45-b818d738334a tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] 10.222.0.33 "GET /compute/v2.1/servers/db62c05e-28a8-4121-a6e5-8abb802f7a17" status: 200 len: 1292 microversion: 2.1 time: 0.425566 Jul 18 10:29:13.512646 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 19/36] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:29:13 2022] GET /compute/v2.1/servers/db62c05e-28a8-4121-a6e5-8abb802f7a17 => generated 1292 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:29:13.608321 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-f286176f-0ec3-43f9-85d2-9eaaf5f7f9da tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '986f90dfbad14324b3fffbd790d60a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e487deb7ff45bdbf2cc002d42d12a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:29:13.625925 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-f286176f-0ec3-43f9-85d2-9eaaf5f7f9da tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] 10.222.0.33 "GET /compute/v2.1/servers/dcb1b50b-9e62-4ff3-9875-3d4635597b45" status: 200 len: 1236 microversion: 2.1 time: 0.264356 Jul 18 10:29:13.626525 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 18/37] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:29:13 2022] GET /compute/v2.1/servers/dcb1b50b-9e62-4ff3-9875-3d4635597b45 => generated 1236 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:29:13.627867 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-ffae0869-7327-4029-9ee3-089280c7f97a tempest-VolumesSnapshotsTestJSON-1195547464 tempest-VolumesSnapshotsTestJSON-1195547464-project] Calling method '.version_select at 0x7f9f4a4c0040>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:29:13.826489 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.wsgi [None req-ffae0869-7327-4029-9ee3-089280c7f97a tempest-VolumesSnapshotsTestJSON-1195547464 tempest-VolumesSnapshotsTestJSON-1195547464-project] HTTP exception thrown: Volume 77133285-5d30-43db-abc0-558b5fabd9a1 could not be found. Jul 18 10:29:13.829731 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-ffae0869-7327-4029-9ee3-089280c7f97a tempest-VolumesSnapshotsTestJSON-1195547464 tempest-VolumesSnapshotsTestJSON-1195547464-project] Request method failure captured: Jul 18 10:29:13.829731 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: request: GET /compute/v2.1/os-volumes/77133285-5d30-43db-abc0-558b5fabd9a1 HTTP/1.1 Jul 18 10:29:13.829731 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: Accept: application/json Jul 18 10:29:13.829731 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: Accept-Encoding: identity Jul 18 10:29:13.829731 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: Connection: close Jul 18 10:29:13.829731 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: Content-Length: 0 Jul 18 10:29:13.829731 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: Content-Type: application/json Jul 18 10:29:13.829731 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: Host: 10.222.0.33 Jul 18 10:29:13.829731 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: Openstack-System-Scope: None Jul 18 10:29:13.829731 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: User-Agent: python-urllib3/1.26.9 Jul 18 10:29:13.829731 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Auth-Token: gAAAAABi1TXixweqjqnyphbCvJ-bgx5GKZUAPPQn2CZgV8oQnf6sGBuzAqpODPoPcnqdGys70ARb57I0hn3hcrjtLao_H9-hFUQ5L6bIcAOUNIZLwURgTbWjCjINITKlTslONrAxIiOCDFYErZ3ILONwEZtjytVkRWqsbNjI4ILFn_RWOotPeiY Jul 18 10:29:13.829731 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Domain-Id: None Jul 18 10:29:13.829731 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Domain-Name: None Jul 18 10:29:13.829731 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Identity-Status: Confirmed Jul 18 10:29:13.829731 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Is-Admin-Project: True Jul 18 10:29:13.829731 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Project-Domain-Id: default Jul 18 10:29:13.829731 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Project-Domain-Name: Default Jul 18 10:29:13.829731 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Project-Id: 926f2ef83f424b9f830078de3486361f Jul 18 10:29:13.829731 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1195547464 Jul 18 10:29:13.829731 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Role: member,reader Jul 18 10:29:13.829731 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Roles: member,reader Jul 18 10:29:13.831064 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/926f2ef83f424b9f830078de3486361f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/926f2ef83f424b9f830078de3486361f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/926f2ef83f424b9f830078de3486361f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_926f2ef83f424b9f830078de3486361f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jul 18 10:29:13.831064 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1195547464 Jul 18 10:29:13.831064 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Tenant-Id: 926f2ef83f424b9f830078de3486361f Jul 18 10:29:13.831064 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1195547464 Jul 18 10:29:13.831064 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-User: tempest-VolumesSnapshotsTestJSON-1195547464-project Jul 18 10:29:13.831064 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-User-Domain-Id: default Jul 18 10:29:13.831064 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-User-Domain-Name: Default Jul 18 10:29:13.831064 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-User-Id: efcd904b529f44f1a7511d6d9009d40a Jul 18 10:29:13.831064 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1195547464-project Jul 18 10:29:13.831064 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: method: Jul 18 10:29:13.831064 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: exception: Volume 77133285-5d30-43db-abc0-558b5fabd9a1 could not be found. Jul 18 10:29:13.831064 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: action_args: {'id': '77133285-5d30-43db-abc0-558b5fabd9a1'} Jul 18 10:29:13.831064 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 10:29:13.831998 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:29:13.831998 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 18 10:29:13.831998 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 18 10:29:13.831998 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 18 10:29:13.831998 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 18 10:29:13.831998 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 18 10:29:13.831998 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 18 10:29:13.831998 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 18 10:29:13.831998 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 18 10:29:13.831998 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 18 10:29:13.831998 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 18 10:29:13.831998 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 18 10:29:13.831998 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 18 10:29:13.831998 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 18 10:29:13.831998 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 18 10:29:13.831998 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 77133285-5d30-43db-abc0-558b5fabd9a1 could not be found. (HTTP 404) (Request-ID: req-c27e0714-a9ff-496c-8a53-8d4ced058ef2) Jul 18 10:29:13.831998 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi Jul 18 10:29:13.831998 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:29:13.831998 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi Jul 18 10:29:13.833267 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:29:13.833267 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 18 10:29:13.833267 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 18 10:29:13.833267 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 18 10:29:13.833267 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 18 10:29:13.833267 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 18 10:29:13.833267 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 18 10:29:13.833267 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 18 10:29:13.833267 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 18 10:29:13.833267 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 18 10:29:13.833267 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 18 10:29:13.833267 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 18 10:29:13.833267 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 18 10:29:13.833267 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 18 10:29:13.833267 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 18 10:29:13.833267 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 18 10:29:13.833267 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 18 10:29:13.833267 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 18 10:29:13.833267 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 18 10:29:13.834733 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 18 10:29:13.834733 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 18 10:29:13.834733 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 18 10:29:13.834733 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 18 10:29:13.834733 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 77133285-5d30-43db-abc0-558b5fabd9a1 could not be found. Jul 18 10:29:13.834733 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi Jul 18 10:29:13.834733 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:29:13.834733 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi Jul 18 10:29:13.834733 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:29:13.834733 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:29:13.834733 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:29:13.834733 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 10:29:13.834733 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 10:29:13.834733 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 10:29:13.834733 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 10:29:13.834733 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 10:29:13.834733 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 10:29:13.834733 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 18 10:29:13.834733 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 10:29:13.835892 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 77133285-5d30-43db-abc0-558b5fabd9a1 could not be found. Jul 18 10:29:13.835892 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi Jul 18 10:29:13.835892 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:29:13.835892 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi Jul 18 10:29:13.835892 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:29:13.835892 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:29:13.835892 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:29:13.835892 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 10:29:13.835892 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 10:29:13.835892 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 77133285-5d30-43db-abc0-558b5fabd9a1 could not be found. Jul 18 10:29:13.835892 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi Jul 18 10:29:13.835892 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-ffae0869-7327-4029-9ee3-089280c7f97a tempest-VolumesSnapshotsTestJSON-1195547464 tempest-VolumesSnapshotsTestJSON-1195547464-project] Returning 404 to user: Volume 77133285-5d30-43db-abc0-558b5fabd9a1 could not be found. {{(pid=117880) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 10:29:13.835892 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-ffae0869-7327-4029-9ee3-089280c7f97a tempest-VolumesSnapshotsTestJSON-1195547464 tempest-VolumesSnapshotsTestJSON-1195547464-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/77133285-5d30-43db-abc0-558b5fabd9a1" status: 404 len: 109 microversion: 2.1 time: 0.211751 Jul 18 10:29:13.838354 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 20/38] 10.222.0.33 () {58 vars in 1244 bytes} [Mon Jul 18 10:29:13 2022] GET /compute/v2.1/os-volumes/77133285-5d30-43db-abc0-558b5fabd9a1 => generated 109 bytes in 216 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 10:29:13.855662 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-f0594a23-f43a-47d2-b190-bea0b4e2ebbd tempest-VolumesSnapshotsTestJSON-1195547464 tempest-VolumesSnapshotsTestJSON-1195547464-project] Calling method '.version_select at 0x7f9f4ae16040>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:29:13.947717 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.wsgi [None req-f0594a23-f43a-47d2-b190-bea0b4e2ebbd tempest-VolumesSnapshotsTestJSON-1195547464 tempest-VolumesSnapshotsTestJSON-1195547464-project] HTTP exception thrown: Volume 77133285-5d30-43db-abc0-558b5fabd9a1 could not be found. Jul 18 10:29:13.951917 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-f0594a23-f43a-47d2-b190-bea0b4e2ebbd tempest-VolumesSnapshotsTestJSON-1195547464 tempest-VolumesSnapshotsTestJSON-1195547464-project] Request method failure captured: Jul 18 10:29:13.951917 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: request: DELETE /compute/v2.1/os-volumes/77133285-5d30-43db-abc0-558b5fabd9a1 HTTP/1.1 Jul 18 10:29:13.951917 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: Accept: application/json Jul 18 10:29:13.951917 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: Accept-Encoding: identity Jul 18 10:29:13.951917 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: Connection: close Jul 18 10:29:13.951917 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: Content-Length: 0 Jul 18 10:29:13.951917 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: Content-Type: application/json Jul 18 10:29:13.951917 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: Host: 10.222.0.33 Jul 18 10:29:13.951917 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: Openstack-System-Scope: None Jul 18 10:29:13.951917 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: User-Agent: python-urllib3/1.26.9 Jul 18 10:29:13.951917 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Auth-Token: gAAAAABi1TXixweqjqnyphbCvJ-bgx5GKZUAPPQn2CZgV8oQnf6sGBuzAqpODPoPcnqdGys70ARb57I0hn3hcrjtLao_H9-hFUQ5L6bIcAOUNIZLwURgTbWjCjINITKlTslONrAxIiOCDFYErZ3ILONwEZtjytVkRWqsbNjI4ILFn_RWOotPeiY Jul 18 10:29:13.951917 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Domain-Id: None Jul 18 10:29:13.951917 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Domain-Name: None Jul 18 10:29:13.951917 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Identity-Status: Confirmed Jul 18 10:29:13.951917 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Is-Admin-Project: True Jul 18 10:29:13.951917 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Project-Domain-Id: default Jul 18 10:29:13.951917 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Project-Domain-Name: Default Jul 18 10:29:13.951917 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Project-Id: 926f2ef83f424b9f830078de3486361f Jul 18 10:29:13.951917 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1195547464 Jul 18 10:29:13.951917 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Role: member,reader Jul 18 10:29:13.951917 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Roles: member,reader Jul 18 10:29:13.953367 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/926f2ef83f424b9f830078de3486361f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/926f2ef83f424b9f830078de3486361f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/926f2ef83f424b9f830078de3486361f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_926f2ef83f424b9f830078de3486361f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jul 18 10:29:13.953367 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1195547464 Jul 18 10:29:13.953367 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Tenant-Id: 926f2ef83f424b9f830078de3486361f Jul 18 10:29:13.953367 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1195547464 Jul 18 10:29:13.953367 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-User: tempest-VolumesSnapshotsTestJSON-1195547464-project Jul 18 10:29:13.953367 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-User-Domain-Id: default Jul 18 10:29:13.953367 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-User-Domain-Name: Default Jul 18 10:29:13.953367 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-User-Id: efcd904b529f44f1a7511d6d9009d40a Jul 18 10:29:13.953367 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1195547464-project Jul 18 10:29:13.953367 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: method: Jul 18 10:29:13.953367 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: exception: Volume 77133285-5d30-43db-abc0-558b5fabd9a1 could not be found. Jul 18 10:29:13.953367 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: action_args: {'id': '77133285-5d30-43db-abc0-558b5fabd9a1'} Jul 18 10:29:13.953367 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 10:29:13.954412 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:29:13.954412 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 18 10:29:13.954412 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 18 10:29:13.954412 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 18 10:29:13.954412 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 18 10:29:13.954412 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 18 10:29:13.954412 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 18 10:29:13.954412 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 18 10:29:13.954412 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 18 10:29:13.954412 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 18 10:29:13.954412 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 18 10:29:13.954412 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 18 10:29:13.954412 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 18 10:29:13.954412 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 18 10:29:13.954412 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 18 10:29:13.954412 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 77133285-5d30-43db-abc0-558b5fabd9a1 could not be found. (HTTP 404) (Request-ID: req-7bea2333-7a36-45bc-97b6-2c4f9852f01e) Jul 18 10:29:13.954412 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi Jul 18 10:29:13.954412 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:29:13.954412 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi Jul 18 10:29:13.955708 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:29:13.955708 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 18 10:29:13.955708 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 18 10:29:13.955708 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 18 10:29:13.955708 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 18 10:29:13.955708 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 18 10:29:13.955708 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 18 10:29:13.955708 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 18 10:29:13.955708 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 18 10:29:13.955708 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 18 10:29:13.955708 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 18 10:29:13.955708 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 18 10:29:13.955708 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 18 10:29:13.955708 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 18 10:29:13.955708 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 18 10:29:13.955708 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 18 10:29:13.955708 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 18 10:29:13.955708 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 18 10:29:13.955708 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 18 10:29:13.957040 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 18 10:29:13.957040 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 18 10:29:13.957040 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 18 10:29:13.957040 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 18 10:29:13.957040 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 77133285-5d30-43db-abc0-558b5fabd9a1 could not be found. Jul 18 10:29:13.957040 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi Jul 18 10:29:13.957040 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:29:13.957040 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi Jul 18 10:29:13.957040 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:29:13.957040 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:29:13.957040 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:29:13.957040 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 10:29:13.957040 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 10:29:13.957040 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 10:29:13.957040 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 10:29:13.957040 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 10:29:13.957040 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 10:29:13.957040 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 18 10:29:13.957040 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 10:29:13.958979 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 77133285-5d30-43db-abc0-558b5fabd9a1 could not be found. Jul 18 10:29:13.958979 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi Jul 18 10:29:13.958979 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:29:13.958979 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi Jul 18 10:29:13.958979 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:29:13.958979 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:29:13.958979 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:29:13.958979 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 10:29:13.958979 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 10:29:13.958979 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 77133285-5d30-43db-abc0-558b5fabd9a1 could not be found. Jul 18 10:29:13.958979 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi Jul 18 10:29:13.973808 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-f0594a23-f43a-47d2-b190-bea0b4e2ebbd tempest-VolumesSnapshotsTestJSON-1195547464 tempest-VolumesSnapshotsTestJSON-1195547464-project] Returning 404 to user: Volume 77133285-5d30-43db-abc0-558b5fabd9a1 could not be found. {{(pid=117879) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 10:29:13.987062 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-f0594a23-f43a-47d2-b190-bea0b4e2ebbd tempest-VolumesSnapshotsTestJSON-1195547464 tempest-VolumesSnapshotsTestJSON-1195547464-project] 10.222.0.33 "DELETE /compute/v2.1/os-volumes/77133285-5d30-43db-abc0-558b5fabd9a1" status: 404 len: 109 microversion: 2.1 time: 0.139300 Jul 18 10:29:13.990452 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 19/39] 10.222.0.33 () {58 vars in 1247 bytes} [Mon Jul 18 10:29:13 2022] DELETE /compute/v2.1/os-volumes/77133285-5d30-43db-abc0-558b5fabd9a1 => generated 109 bytes in 147 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 10:29:13.998311 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-9c781e88-5298-4f59-ac80-3d1d399c14b8 tempest-VolumesSnapshotsTestJSON-1195547464 tempest-VolumesSnapshotsTestJSON-1195547464-project] Calling method '.version_select at 0x7f9f4a4c0af0>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:29:14.066135 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.wsgi [None req-9c781e88-5298-4f59-ac80-3d1d399c14b8 tempest-VolumesSnapshotsTestJSON-1195547464 tempest-VolumesSnapshotsTestJSON-1195547464-project] HTTP exception thrown: Volume 77133285-5d30-43db-abc0-558b5fabd9a1 could not be found. Jul 18 10:29:14.069519 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-9c781e88-5298-4f59-ac80-3d1d399c14b8 tempest-VolumesSnapshotsTestJSON-1195547464 tempest-VolumesSnapshotsTestJSON-1195547464-project] Request method failure captured: Jul 18 10:29:14.069519 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: request: GET /compute/v2.1/os-volumes/77133285-5d30-43db-abc0-558b5fabd9a1 HTTP/1.1 Jul 18 10:29:14.069519 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: Accept: application/json Jul 18 10:29:14.069519 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: Accept-Encoding: identity Jul 18 10:29:14.069519 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: Connection: close Jul 18 10:29:14.069519 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: Content-Length: 0 Jul 18 10:29:14.069519 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: Content-Type: application/json Jul 18 10:29:14.069519 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: Host: 10.222.0.33 Jul 18 10:29:14.069519 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: Openstack-System-Scope: None Jul 18 10:29:14.069519 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: User-Agent: python-urllib3/1.26.9 Jul 18 10:29:14.069519 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Auth-Token: gAAAAABi1TXixweqjqnyphbCvJ-bgx5GKZUAPPQn2CZgV8oQnf6sGBuzAqpODPoPcnqdGys70ARb57I0hn3hcrjtLao_H9-hFUQ5L6bIcAOUNIZLwURgTbWjCjINITKlTslONrAxIiOCDFYErZ3ILONwEZtjytVkRWqsbNjI4ILFn_RWOotPeiY Jul 18 10:29:14.069519 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Domain-Id: None Jul 18 10:29:14.069519 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Domain-Name: None Jul 18 10:29:14.069519 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Identity-Status: Confirmed Jul 18 10:29:14.069519 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Is-Admin-Project: True Jul 18 10:29:14.069519 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Project-Domain-Id: default Jul 18 10:29:14.069519 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Project-Domain-Name: Default Jul 18 10:29:14.069519 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Project-Id: 926f2ef83f424b9f830078de3486361f Jul 18 10:29:14.069519 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1195547464 Jul 18 10:29:14.069519 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Role: member,reader Jul 18 10:29:14.069519 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Roles: member,reader Jul 18 10:29:14.070877 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/926f2ef83f424b9f830078de3486361f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/926f2ef83f424b9f830078de3486361f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/926f2ef83f424b9f830078de3486361f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_926f2ef83f424b9f830078de3486361f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jul 18 10:29:14.070877 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1195547464 Jul 18 10:29:14.070877 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Tenant-Id: 926f2ef83f424b9f830078de3486361f Jul 18 10:29:14.070877 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1195547464 Jul 18 10:29:14.070877 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-User: tempest-VolumesSnapshotsTestJSON-1195547464-project Jul 18 10:29:14.070877 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-User-Domain-Id: default Jul 18 10:29:14.070877 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-User-Domain-Name: Default Jul 18 10:29:14.070877 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-User-Id: efcd904b529f44f1a7511d6d9009d40a Jul 18 10:29:14.070877 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1195547464-project Jul 18 10:29:14.070877 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: method: Jul 18 10:29:14.070877 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: exception: Volume 77133285-5d30-43db-abc0-558b5fabd9a1 could not be found. Jul 18 10:29:14.070877 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: action_args: {'id': '77133285-5d30-43db-abc0-558b5fabd9a1'} Jul 18 10:29:14.070877 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 10:29:14.074908 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:29:14.074908 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 18 10:29:14.074908 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 18 10:29:14.074908 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 18 10:29:14.074908 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 18 10:29:14.074908 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 18 10:29:14.074908 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 18 10:29:14.074908 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 18 10:29:14.074908 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 18 10:29:14.074908 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 18 10:29:14.074908 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 18 10:29:14.074908 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 18 10:29:14.074908 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 18 10:29:14.074908 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 18 10:29:14.074908 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 18 10:29:14.074908 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 77133285-5d30-43db-abc0-558b5fabd9a1 could not be found. (HTTP 404) (Request-ID: req-e51149d1-f80f-44c4-8929-5d274b4f8ca4) Jul 18 10:29:14.074908 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi Jul 18 10:29:14.074908 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:29:14.074908 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi Jul 18 10:29:14.076160 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:29:14.076160 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 18 10:29:14.076160 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 18 10:29:14.076160 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 18 10:29:14.076160 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 18 10:29:14.076160 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 18 10:29:14.076160 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 18 10:29:14.076160 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 18 10:29:14.076160 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 18 10:29:14.076160 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 18 10:29:14.076160 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 18 10:29:14.076160 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 18 10:29:14.076160 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 18 10:29:14.076160 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 18 10:29:14.076160 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 18 10:29:14.076160 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 18 10:29:14.076160 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 18 10:29:14.076160 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 18 10:29:14.076160 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 18 10:29:14.080430 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 18 10:29:14.080430 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 18 10:29:14.080430 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 18 10:29:14.080430 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 18 10:29:14.080430 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 77133285-5d30-43db-abc0-558b5fabd9a1 could not be found. Jul 18 10:29:14.080430 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi Jul 18 10:29:14.080430 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:29:14.080430 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi Jul 18 10:29:14.080430 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:29:14.080430 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:29:14.080430 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:29:14.080430 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 10:29:14.080430 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 10:29:14.080430 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 10:29:14.080430 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 10:29:14.080430 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 10:29:14.080430 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 10:29:14.080430 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 18 10:29:14.080430 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 10:29:14.081656 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 77133285-5d30-43db-abc0-558b5fabd9a1 could not be found. Jul 18 10:29:14.081656 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi Jul 18 10:29:14.081656 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:29:14.081656 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi Jul 18 10:29:14.081656 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:29:14.081656 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:29:14.081656 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:29:14.081656 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 10:29:14.081656 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 10:29:14.081656 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 77133285-5d30-43db-abc0-558b5fabd9a1 could not be found. Jul 18 10:29:14.081656 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi Jul 18 10:29:14.081656 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-9c781e88-5298-4f59-ac80-3d1d399c14b8 tempest-VolumesSnapshotsTestJSON-1195547464 tempest-VolumesSnapshotsTestJSON-1195547464-project] Returning 404 to user: Volume 77133285-5d30-43db-abc0-558b5fabd9a1 could not be found. {{(pid=117880) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 10:29:14.081656 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-9c781e88-5298-4f59-ac80-3d1d399c14b8 tempest-VolumesSnapshotsTestJSON-1195547464 tempest-VolumesSnapshotsTestJSON-1195547464-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/77133285-5d30-43db-abc0-558b5fabd9a1" status: 404 len: 109 microversion: 2.1 time: 0.077394 Jul 18 10:29:14.081656 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 21/40] 10.222.0.33 () {58 vars in 1244 bytes} [Mon Jul 18 10:29:13 2022] GET /compute/v2.1/os-volumes/77133285-5d30-43db-abc0-558b5fabd9a1 => generated 109 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 10:29:14.101564 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-43bdde5c-6788-4041-9032-583de3eb0c1a tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:29:14.102187 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-43bdde5c-6788-4041-9032-583de3eb0c1a tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] [instance: 78bb7f95-9846-4a59-9f77-a3fe69005eec] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:29:14.126343 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-43bdde5c-6788-4041-9032-583de3eb0c1a tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:29:14.134524 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-43bdde5c-6788-4041-9032-583de3eb0c1a tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:29:14.149613 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-43bdde5c-6788-4041-9032-583de3eb0c1a tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:29:14.151794 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-43bdde5c-6788-4041-9032-583de3eb0c1a tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:29:14.378921 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-f959bd72-2a3a-4e58-b181-0065833b99ac tempest-DeleteServersTestJSON-1052419078 tempest-DeleteServersTestJSON-1052419078-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:29:14.380409 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-f959bd72-2a3a-4e58-b181-0065833b99ac tempest-DeleteServersTestJSON-1052419078 tempest-DeleteServersTestJSON-1052419078-project] [instance: df938010-ebc5-429f-8499-4b55eff7cab9] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:29:14.408117 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-f959bd72-2a3a-4e58-b181-0065833b99ac tempest-DeleteServersTestJSON-1052419078 tempest-DeleteServersTestJSON-1052419078-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:29:14.410114 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-f959bd72-2a3a-4e58-b181-0065833b99ac tempest-DeleteServersTestJSON-1052419078 tempest-DeleteServersTestJSON-1052419078-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:29:14.414606 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-f959bd72-2a3a-4e58-b181-0065833b99ac tempest-DeleteServersTestJSON-1052419078 tempest-DeleteServersTestJSON-1052419078-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:29:14.415144 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-f959bd72-2a3a-4e58-b181-0065833b99ac tempest-DeleteServersTestJSON-1052419078 tempest-DeleteServersTestJSON-1052419078-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:29:14.782597 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-43bdde5c-6788-4041-9032-583de3eb0c1a tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a431c9708f4694bc0d514133e76088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a1921237622439bab89676e11477c13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:29:14.841685 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-43bdde5c-6788-4041-9032-583de3eb0c1a tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] 10.222.0.33 "GET /compute/v2.1/servers/78bb7f95-9846-4a59-9f77-a3fe69005eec" status: 200 len: 1273 microversion: 2.1 time: 0.745526 Jul 18 10:29:14.847881 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 20/41] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:29:14 2022] GET /compute/v2.1/servers/78bb7f95-9846-4a59-9f77-a3fe69005eec => generated 1273 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:29:14.871779 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-63e703ef-5bdd-4f42-baa9-252f8dadec75 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:29:14.875691 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-63e703ef-5bdd-4f42-baa9-252f8dadec75 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] [instance: db62c05e-28a8-4121-a6e5-8abb802f7a17] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:29:14.912756 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-63e703ef-5bdd-4f42-baa9-252f8dadec75 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:29:14.918137 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-63e703ef-5bdd-4f42-baa9-252f8dadec75 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:29:14.920219 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-63e703ef-5bdd-4f42-baa9-252f8dadec75 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:29:14.921848 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-63e703ef-5bdd-4f42-baa9-252f8dadec75 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:29:15.027253 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-f959bd72-2a3a-4e58-b181-0065833b99ac tempest-DeleteServersTestJSON-1052419078 tempest-DeleteServersTestJSON-1052419078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0f993e44c624f65abae22540ce7dffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daab623e57e54081b262d4a8fe124f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:29:15.040818 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-f959bd72-2a3a-4e58-b181-0065833b99ac tempest-DeleteServersTestJSON-1052419078 tempest-DeleteServersTestJSON-1052419078-project] 10.222.0.33 "GET /compute/v2.1/servers/df938010-ebc5-429f-8499-4b55eff7cab9" status: 200 len: 1211 microversion: 2.1 time: 0.664096 Jul 18 10:29:15.055426 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 22/42] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:29:14 2022] GET /compute/v2.1/servers/df938010-ebc5-429f-8499-4b55eff7cab9 => generated 1211 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:29:15.096389 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-7cad9079-06ff-4133-88ce-6606bea2a00f tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:29:15.101193 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-7cad9079-06ff-4133-88ce-6606bea2a00f tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] [instance: dcb1b50b-9e62-4ff3-9875-3d4635597b45] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:29:15.130949 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-7cad9079-06ff-4133-88ce-6606bea2a00f tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:29:15.135214 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-7cad9079-06ff-4133-88ce-6606bea2a00f tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:29:15.139205 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-7cad9079-06ff-4133-88ce-6606bea2a00f tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:29:15.140959 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-7cad9079-06ff-4133-88ce-6606bea2a00f tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:29:15.224812 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-63e703ef-5bdd-4f42-baa9-252f8dadec75 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f25c72896a2d4d619e5ad4b5a0a79aa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cf3d5bfe9a745f38372c42c9cfa1f63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:29:15.235277 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-63e703ef-5bdd-4f42-baa9-252f8dadec75 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] 10.222.0.33 "GET /compute/v2.1/servers/db62c05e-28a8-4121-a6e5-8abb802f7a17" status: 200 len: 1310 microversion: 2.1 time: 0.383805 Jul 18 10:29:15.235861 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 21/43] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:29:14 2022] GET /compute/v2.1/servers/db62c05e-28a8-4121-a6e5-8abb802f7a17 => generated 1310 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:29:15.389548 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-7cad9079-06ff-4133-88ce-6606bea2a00f tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '986f90dfbad14324b3fffbd790d60a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e487deb7ff45bdbf2cc002d42d12a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:29:15.447403 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-7cad9079-06ff-4133-88ce-6606bea2a00f tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] 10.222.0.33 "GET /compute/v2.1/servers/dcb1b50b-9e62-4ff3-9875-3d4635597b45" status: 200 len: 1232 microversion: 2.1 time: 0.387249 Jul 18 10:29:15.463248 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 23/44] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:29:15 2022] GET /compute/v2.1/servers/dcb1b50b-9e62-4ff3-9875-3d4635597b45 => generated 1232 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:29:15.866030 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-c70e837b-7312-4db5-bf89-49304c92698a tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:29:15.867094 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-c70e837b-7312-4db5-bf89-49304c92698a tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] [instance: 78bb7f95-9846-4a59-9f77-a3fe69005eec] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:29:15.876929 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-c70e837b-7312-4db5-bf89-49304c92698a tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:29:15.878098 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-c70e837b-7312-4db5-bf89-49304c92698a tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:29:15.880810 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-c70e837b-7312-4db5-bf89-49304c92698a tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:29:15.882881 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-c70e837b-7312-4db5-bf89-49304c92698a tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:29:16.058304 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-508fb25f-88af-4f32-9577-93b7cd088642 tempest-DeleteServersTestJSON-1052419078 tempest-DeleteServersTestJSON-1052419078-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:29:16.058922 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-508fb25f-88af-4f32-9577-93b7cd088642 tempest-DeleteServersTestJSON-1052419078 tempest-DeleteServersTestJSON-1052419078-project] [instance: df938010-ebc5-429f-8499-4b55eff7cab9] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:29:16.069746 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-508fb25f-88af-4f32-9577-93b7cd088642 tempest-DeleteServersTestJSON-1052419078 tempest-DeleteServersTestJSON-1052419078-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:29:16.070201 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-508fb25f-88af-4f32-9577-93b7cd088642 tempest-DeleteServersTestJSON-1052419078 tempest-DeleteServersTestJSON-1052419078-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:29:16.070975 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-508fb25f-88af-4f32-9577-93b7cd088642 tempest-DeleteServersTestJSON-1052419078 tempest-DeleteServersTestJSON-1052419078-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:29:16.071408 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-508fb25f-88af-4f32-9577-93b7cd088642 tempest-DeleteServersTestJSON-1052419078 tempest-DeleteServersTestJSON-1052419078-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:29:16.233183 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-c70e837b-7312-4db5-bf89-49304c92698a tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a431c9708f4694bc0d514133e76088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a1921237622439bab89676e11477c13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:29:16.243841 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-c70e837b-7312-4db5-bf89-49304c92698a tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] 10.222.0.33 "GET /compute/v2.1/servers/78bb7f95-9846-4a59-9f77-a3fe69005eec" status: 200 len: 1279 microversion: 2.1 time: 0.380171 Jul 18 10:29:16.245610 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 22/45] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:29:15 2022] GET /compute/v2.1/servers/78bb7f95-9846-4a59-9f77-a3fe69005eec => generated 1279 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:29:16.266049 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-a8f60451-db25-4a7b-a3e8-3282900f6ba3 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:29:16.266675 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-a8f60451-db25-4a7b-a3e8-3282900f6ba3 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] [instance: db62c05e-28a8-4121-a6e5-8abb802f7a17] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:29:16.304211 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-a8f60451-db25-4a7b-a3e8-3282900f6ba3 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:29:16.304709 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-a8f60451-db25-4a7b-a3e8-3282900f6ba3 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:29:16.317952 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-a8f60451-db25-4a7b-a3e8-3282900f6ba3 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:29:16.328833 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-a8f60451-db25-4a7b-a3e8-3282900f6ba3 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:29:17.146512 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-508fb25f-88af-4f32-9577-93b7cd088642 tempest-DeleteServersTestJSON-1052419078 tempest-DeleteServersTestJSON-1052419078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0f993e44c624f65abae22540ce7dffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daab623e57e54081b262d4a8fe124f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:29:17.154543 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-508fb25f-88af-4f32-9577-93b7cd088642 tempest-DeleteServersTestJSON-1052419078 tempest-DeleteServersTestJSON-1052419078-project] 10.222.0.33 "GET /compute/v2.1/servers/df938010-ebc5-429f-8499-4b55eff7cab9" status: 200 len: 1273 microversion: 2.1 time: 1.100112 Jul 18 10:29:17.161178 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 24/46] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:29:16 2022] GET /compute/v2.1/servers/df938010-ebc5-429f-8499-4b55eff7cab9 => generated 1273 bytes in 1107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:29:17.165916 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-efb3a53b-87ba-472b-9881-995fdcf7d8fe tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:29:17.174140 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-efb3a53b-87ba-472b-9881-995fdcf7d8fe tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] [instance: dcb1b50b-9e62-4ff3-9875-3d4635597b45] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:29:17.184305 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-efb3a53b-87ba-472b-9881-995fdcf7d8fe tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:29:17.184953 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-efb3a53b-87ba-472b-9881-995fdcf7d8fe tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:29:17.185727 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-efb3a53b-87ba-472b-9881-995fdcf7d8fe tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:29:17.186162 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-efb3a53b-87ba-472b-9881-995fdcf7d8fe tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:29:17.282118 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-a8f60451-db25-4a7b-a3e8-3282900f6ba3 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f25c72896a2d4d619e5ad4b5a0a79aa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cf3d5bfe9a745f38372c42c9cfa1f63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:29:17.291968 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-a8f60451-db25-4a7b-a3e8-3282900f6ba3 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] 10.222.0.33 "GET /compute/v2.1/servers/db62c05e-28a8-4121-a6e5-8abb802f7a17" status: 200 len: 1298 microversion: 2.1 time: 1.041569 Jul 18 10:29:17.292730 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 23/47] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:29:16 2022] GET /compute/v2.1/servers/db62c05e-28a8-4121-a6e5-8abb802f7a17 => generated 1298 bytes in 1044 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:29:17.309143 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-05ddda34-2a73-4930-a812-a4ff7f0045dd tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:29:17.309955 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-05ddda34-2a73-4930-a812-a4ff7f0045dd tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] [instance: 78bb7f95-9846-4a59-9f77-a3fe69005eec] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:29:17.323130 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-05ddda34-2a73-4930-a812-a4ff7f0045dd tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:29:17.323584 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-05ddda34-2a73-4930-a812-a4ff7f0045dd tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:29:17.324357 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-05ddda34-2a73-4930-a812-a4ff7f0045dd tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:29:17.324835 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-05ddda34-2a73-4930-a812-a4ff7f0045dd tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:29:17.531537 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-efb3a53b-87ba-472b-9881-995fdcf7d8fe tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '986f90dfbad14324b3fffbd790d60a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e487deb7ff45bdbf2cc002d42d12a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:29:17.542735 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-efb3a53b-87ba-472b-9881-995fdcf7d8fe tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] 10.222.0.33 "GET /compute/v2.1/servers/dcb1b50b-9e62-4ff3-9875-3d4635597b45" status: 200 len: 1288 microversion: 2.1 time: 0.378214 Jul 18 10:29:17.543613 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 25/48] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:29:17 2022] GET /compute/v2.1/servers/dcb1b50b-9e62-4ff3-9875-3d4635597b45 => generated 1288 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:29:17.586156 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-05ddda34-2a73-4930-a812-a4ff7f0045dd tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a431c9708f4694bc0d514133e76088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a1921237622439bab89676e11477c13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:29:17.600590 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-05ddda34-2a73-4930-a812-a4ff7f0045dd tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] 10.222.0.33 "GET /compute/v2.1/servers/78bb7f95-9846-4a59-9f77-a3fe69005eec" status: 200 len: 1279 microversion: 2.1 time: 0.295745 Jul 18 10:29:17.601386 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 24/49] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:29:17 2022] GET /compute/v2.1/servers/78bb7f95-9846-4a59-9f77-a3fe69005eec => generated 1279 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:29:18.175015 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-34d09e8f-b742-4fdf-b07d-d6c1fd9d4035 tempest-DeleteServersTestJSON-1052419078 tempest-DeleteServersTestJSON-1052419078-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:29:18.175756 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-34d09e8f-b742-4fdf-b07d-d6c1fd9d4035 tempest-DeleteServersTestJSON-1052419078 tempest-DeleteServersTestJSON-1052419078-project] [instance: df938010-ebc5-429f-8499-4b55eff7cab9] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:29:18.187156 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-34d09e8f-b742-4fdf-b07d-d6c1fd9d4035 tempest-DeleteServersTestJSON-1052419078 tempest-DeleteServersTestJSON-1052419078-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:29:18.187607 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-34d09e8f-b742-4fdf-b07d-d6c1fd9d4035 tempest-DeleteServersTestJSON-1052419078 tempest-DeleteServersTestJSON-1052419078-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:29:18.188625 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-34d09e8f-b742-4fdf-b07d-d6c1fd9d4035 tempest-DeleteServersTestJSON-1052419078 tempest-DeleteServersTestJSON-1052419078-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:29:18.188902 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-34d09e8f-b742-4fdf-b07d-d6c1fd9d4035 tempest-DeleteServersTestJSON-1052419078 tempest-DeleteServersTestJSON-1052419078-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:29:18.292567 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-34d09e8f-b742-4fdf-b07d-d6c1fd9d4035 tempest-DeleteServersTestJSON-1052419078 tempest-DeleteServersTestJSON-1052419078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0f993e44c624f65abae22540ce7dffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daab623e57e54081b262d4a8fe124f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:29:18.308263 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-34d09e8f-b742-4fdf-b07d-d6c1fd9d4035 tempest-DeleteServersTestJSON-1052419078 tempest-DeleteServersTestJSON-1052419078-project] 10.222.0.33 "GET /compute/v2.1/servers/df938010-ebc5-429f-8499-4b55eff7cab9" status: 200 len: 1273 microversion: 2.1 time: 0.137053 Jul 18 10:29:18.308856 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 26/50] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:29:18 2022] GET /compute/v2.1/servers/df938010-ebc5-429f-8499-4b55eff7cab9 => generated 1273 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:29:18.319632 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-298deaf1-8764-46d1-997c-5c25b62fceb9 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:29:18.320441 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-298deaf1-8764-46d1-997c-5c25b62fceb9 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] [instance: db62c05e-28a8-4121-a6e5-8abb802f7a17] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:29:18.333600 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-298deaf1-8764-46d1-997c-5c25b62fceb9 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:29:18.334082 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-298deaf1-8764-46d1-997c-5c25b62fceb9 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:29:18.334968 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-298deaf1-8764-46d1-997c-5c25b62fceb9 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:29:18.335476 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-298deaf1-8764-46d1-997c-5c25b62fceb9 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:29:18.497690 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-298deaf1-8764-46d1-997c-5c25b62fceb9 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f25c72896a2d4d619e5ad4b5a0a79aa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cf3d5bfe9a745f38372c42c9cfa1f63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:29:18.506509 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-298deaf1-8764-46d1-997c-5c25b62fceb9 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] 10.222.0.33 "GET /compute/v2.1/servers/db62c05e-28a8-4121-a6e5-8abb802f7a17" status: 200 len: 1366 microversion: 2.1 time: 0.200578 Jul 18 10:29:18.506807 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 25/51] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:29:18 2022] GET /compute/v2.1/servers/db62c05e-28a8-4121-a6e5-8abb802f7a17 => generated 1366 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:29:18.563008 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-ef2e8034-278d-43b2-a451-a3c7e9f48488 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:29:18.563758 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-ef2e8034-278d-43b2-a451-a3c7e9f48488 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] [instance: dcb1b50b-9e62-4ff3-9875-3d4635597b45] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:29:18.576369 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-ef2e8034-278d-43b2-a451-a3c7e9f48488 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:29:18.577399 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-ef2e8034-278d-43b2-a451-a3c7e9f48488 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:29:18.578671 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-ef2e8034-278d-43b2-a451-a3c7e9f48488 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:29:18.579406 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-ef2e8034-278d-43b2-a451-a3c7e9f48488 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:29:18.626764 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-43d38602-8f6f-4c9b-8fb7-3994ce8024a3 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:29:18.627767 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-43d38602-8f6f-4c9b-8fb7-3994ce8024a3 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] [instance: 78bb7f95-9846-4a59-9f77-a3fe69005eec] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:29:18.671586 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-43d38602-8f6f-4c9b-8fb7-3994ce8024a3 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:29:18.672616 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-43d38602-8f6f-4c9b-8fb7-3994ce8024a3 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:29:18.674617 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-43d38602-8f6f-4c9b-8fb7-3994ce8024a3 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:29:18.677624 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-43d38602-8f6f-4c9b-8fb7-3994ce8024a3 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:29:18.787282 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-ef2e8034-278d-43b2-a451-a3c7e9f48488 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '986f90dfbad14324b3fffbd790d60a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e487deb7ff45bdbf2cc002d42d12a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:29:18.795951 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-ef2e8034-278d-43b2-a451-a3c7e9f48488 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] 10.222.0.33 "GET /compute/v2.1/servers/dcb1b50b-9e62-4ff3-9875-3d4635597b45" status: 200 len: 1288 microversion: 2.1 time: 0.237630 Jul 18 10:29:18.800304 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 27/52] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:29:18 2022] GET /compute/v2.1/servers/dcb1b50b-9e62-4ff3-9875-3d4635597b45 => generated 1288 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:29:18.899470 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-43d38602-8f6f-4c9b-8fb7-3994ce8024a3 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a431c9708f4694bc0d514133e76088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a1921237622439bab89676e11477c13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:29:18.911850 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-43d38602-8f6f-4c9b-8fb7-3994ce8024a3 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] 10.222.0.33 "GET /compute/v2.1/servers/78bb7f95-9846-4a59-9f77-a3fe69005eec" status: 200 len: 1279 microversion: 2.1 time: 0.288228 Jul 18 10:29:18.912492 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 26/53] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:29:18 2022] GET /compute/v2.1/servers/78bb7f95-9846-4a59-9f77-a3fe69005eec => generated 1279 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:29:19.335027 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-c67b1bbe-e894-4894-adbd-0341a2659bf8 tempest-DeleteServersTestJSON-1052419078 tempest-DeleteServersTestJSON-1052419078-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:29:19.335673 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-c67b1bbe-e894-4894-adbd-0341a2659bf8 tempest-DeleteServersTestJSON-1052419078 tempest-DeleteServersTestJSON-1052419078-project] [instance: df938010-ebc5-429f-8499-4b55eff7cab9] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:29:19.362055 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-c67b1bbe-e894-4894-adbd-0341a2659bf8 tempest-DeleteServersTestJSON-1052419078 tempest-DeleteServersTestJSON-1052419078-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:29:19.368845 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-c67b1bbe-e894-4894-adbd-0341a2659bf8 tempest-DeleteServersTestJSON-1052419078 tempest-DeleteServersTestJSON-1052419078-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:29:19.374029 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-c67b1bbe-e894-4894-adbd-0341a2659bf8 tempest-DeleteServersTestJSON-1052419078 tempest-DeleteServersTestJSON-1052419078-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:29:19.376549 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-c67b1bbe-e894-4894-adbd-0341a2659bf8 tempest-DeleteServersTestJSON-1052419078 tempest-DeleteServersTestJSON-1052419078-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:29:19.435705 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-95fcee09-24e0-471a-9b75-9f73b44f84de tempest-VolumesGetTestJSON-1780561274 tempest-VolumesGetTestJSON-1780561274-project] Action: 'create', calling method: .version_select at 0x7f9f4a4e7a60>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-36457852", "metadata": {"Type": "work"}}} {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:29:19.627493 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-c67b1bbe-e894-4894-adbd-0341a2659bf8 tempest-DeleteServersTestJSON-1052419078 tempest-DeleteServersTestJSON-1052419078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0f993e44c624f65abae22540ce7dffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daab623e57e54081b262d4a8fe124f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:29:19.644984 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-c67b1bbe-e894-4894-adbd-0341a2659bf8 tempest-DeleteServersTestJSON-1052419078 tempest-DeleteServersTestJSON-1052419078-project] 10.222.0.33 "GET /compute/v2.1/servers/df938010-ebc5-429f-8499-4b55eff7cab9" status: 200 len: 1273 microversion: 2.1 time: 0.315129 Jul 18 10:29:19.646265 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 27/54] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:29:19 2022] GET /compute/v2.1/servers/df938010-ebc5-429f-8499-4b55eff7cab9 => generated 1273 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:29:19.662584 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-b6265878-6f16-4723-b0e5-19d4afe1e2ad tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:29:19.663538 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-b6265878-6f16-4723-b0e5-19d4afe1e2ad tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] [instance: db62c05e-28a8-4121-a6e5-8abb802f7a17] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:29:19.672107 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-b6265878-6f16-4723-b0e5-19d4afe1e2ad tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:29:19.674479 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-b6265878-6f16-4723-b0e5-19d4afe1e2ad tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:29:19.679801 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-b6265878-6f16-4723-b0e5-19d4afe1e2ad tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:29:19.680972 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-b6265878-6f16-4723-b0e5-19d4afe1e2ad tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:29:20.562313 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-95fcee09-24e0-471a-9b75-9f73b44f84de tempest-VolumesGetTestJSON-1780561274 tempest-VolumesGetTestJSON-1780561274-project] 10.222.0.33 "POST /compute/v2.1/os-volumes" status: 200 len: 351 microversion: 2.1 time: 1.519331 Jul 18 10:29:20.563390 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 28/55] 10.222.0.33 () {60 vars in 1155 bytes} [Mon Jul 18 10:29:19 2022] POST /compute/v2.1/os-volumes => generated 351 bytes in 1528 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jul 18 10:29:20.575057 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-47b91bb7-bb98-4c19-805c-1bc1e9b1e0a3 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:29:20.575739 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-47b91bb7-bb98-4c19-805c-1bc1e9b1e0a3 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] [instance: dcb1b50b-9e62-4ff3-9875-3d4635597b45] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:29:20.590250 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-47b91bb7-bb98-4c19-805c-1bc1e9b1e0a3 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:29:20.590511 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-47b91bb7-bb98-4c19-805c-1bc1e9b1e0a3 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:29:20.592730 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-47b91bb7-bb98-4c19-805c-1bc1e9b1e0a3 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:29:20.598519 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-47b91bb7-bb98-4c19-805c-1bc1e9b1e0a3 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:29:21.137768 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-47b91bb7-bb98-4c19-805c-1bc1e9b1e0a3 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '986f90dfbad14324b3fffbd790d60a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e487deb7ff45bdbf2cc002d42d12a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:29:21.142284 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-b6265878-6f16-4723-b0e5-19d4afe1e2ad tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f25c72896a2d4d619e5ad4b5a0a79aa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cf3d5bfe9a745f38372c42c9cfa1f63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:29:21.153011 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-47b91bb7-bb98-4c19-805c-1bc1e9b1e0a3 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] 10.222.0.33 "GET /compute/v2.1/servers/dcb1b50b-9e62-4ff3-9875-3d4635597b45" status: 200 len: 1294 microversion: 2.1 time: 0.588059 Jul 18 10:29:21.153602 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 29/56] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:29:20 2022] GET /compute/v2.1/servers/dcb1b50b-9e62-4ff3-9875-3d4635597b45 => generated 1294 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:29:21.154905 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-b6265878-6f16-4723-b0e5-19d4afe1e2ad tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] 10.222.0.33 "GET /compute/v2.1/servers/db62c05e-28a8-4121-a6e5-8abb802f7a17" status: 200 len: 1366 microversion: 2.1 time: 1.507353 Jul 18 10:29:21.155708 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 28/57] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:29:19 2022] GET /compute/v2.1/servers/db62c05e-28a8-4121-a6e5-8abb802f7a17 => generated 1366 bytes in 1509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:29:21.170638 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-14ee3f16-0949-4cf7-bbf1-94bbf5afc815 tempest-VolumesGetTestJSON-1780561274 tempest-VolumesGetTestJSON-1780561274-project] Calling method '.version_select at 0x7f9f4acb8f70>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:29:21.171251 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-ffd965ba-f200-4bfc-b669-8286ff3a5bc0 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:29:21.171882 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-ffd965ba-f200-4bfc-b669-8286ff3a5bc0 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] [instance: 78bb7f95-9846-4a59-9f77-a3fe69005eec] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:29:21.198619 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-ffd965ba-f200-4bfc-b669-8286ff3a5bc0 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:29:21.200313 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-ffd965ba-f200-4bfc-b669-8286ff3a5bc0 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:29:21.202605 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-ffd965ba-f200-4bfc-b669-8286ff3a5bc0 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:29:21.204781 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-ffd965ba-f200-4bfc-b669-8286ff3a5bc0 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:29:21.268568 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-14ee3f16-0949-4cf7-bbf1-94bbf5afc815 tempest-VolumesGetTestJSON-1780561274 tempest-VolumesGetTestJSON-1780561274-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/3b024e14-4f01-43a8-9420-dc77e5403b76" status: 200 len: 352 microversion: 2.1 time: 0.108491 Jul 18 10:29:21.269596 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 29/58] 10.222.0.33 () {58 vars in 1244 bytes} [Mon Jul 18 10:29:21 2022] GET /compute/v2.1/os-volumes/3b024e14-4f01-43a8-9420-dc77e5403b76 => generated 352 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:29:21.280674 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-ddde7fdd-da5d-494d-bdc3-2c0b4d503fef tempest-DeleteServersTestJSON-1052419078 tempest-DeleteServersTestJSON-1052419078-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:29:21.281471 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-ddde7fdd-da5d-494d-bdc3-2c0b4d503fef tempest-DeleteServersTestJSON-1052419078 tempest-DeleteServersTestJSON-1052419078-project] [instance: df938010-ebc5-429f-8499-4b55eff7cab9] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:29:21.307874 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-ddde7fdd-da5d-494d-bdc3-2c0b4d503fef tempest-DeleteServersTestJSON-1052419078 tempest-DeleteServersTestJSON-1052419078-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:29:21.309065 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-ddde7fdd-da5d-494d-bdc3-2c0b4d503fef tempest-DeleteServersTestJSON-1052419078 tempest-DeleteServersTestJSON-1052419078-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:29:21.311460 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-ddde7fdd-da5d-494d-bdc3-2c0b4d503fef tempest-DeleteServersTestJSON-1052419078 tempest-DeleteServersTestJSON-1052419078-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:29:21.312183 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-ddde7fdd-da5d-494d-bdc3-2c0b4d503fef tempest-DeleteServersTestJSON-1052419078 tempest-DeleteServersTestJSON-1052419078-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:29:21.854105 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-ddde7fdd-da5d-494d-bdc3-2c0b4d503fef tempest-DeleteServersTestJSON-1052419078 tempest-DeleteServersTestJSON-1052419078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0f993e44c624f65abae22540ce7dffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daab623e57e54081b262d4a8fe124f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:29:21.867589 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-ddde7fdd-da5d-494d-bdc3-2c0b4d503fef tempest-DeleteServersTestJSON-1052419078 tempest-DeleteServersTestJSON-1052419078-project] 10.222.0.33 "GET /compute/v2.1/servers/df938010-ebc5-429f-8499-4b55eff7cab9" status: 200 len: 1273 microversion: 2.1 time: 0.596165 Jul 18 10:29:21.868438 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 30/59] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:29:21 2022] GET /compute/v2.1/servers/df938010-ebc5-429f-8499-4b55eff7cab9 => generated 1273 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:29:21.880195 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-aac82a37-b39e-4195-9e04-063907bca6a8 tempest-VolumesGetTestJSON-1780561274 tempest-VolumesGetTestJSON-1780561274-project] Calling method '.version_select at 0x7f9f4ad281f0>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:29:22.059110 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-aac82a37-b39e-4195-9e04-063907bca6a8 tempest-VolumesGetTestJSON-1780561274 tempest-VolumesGetTestJSON-1780561274-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/3b024e14-4f01-43a8-9420-dc77e5403b76" status: 200 len: 352 microversion: 2.1 time: 0.188689 Jul 18 10:29:22.059795 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 31/60] 10.222.0.33 () {58 vars in 1244 bytes} [Mon Jul 18 10:29:21 2022] GET /compute/v2.1/os-volumes/3b024e14-4f01-43a8-9420-dc77e5403b76 => generated 352 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:29:22.089462 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-1a9f6336-7d3d-4a89-80dc-4999f1499680 tempest-VolumesGetTestJSON-1780561274 tempest-VolumesGetTestJSON-1780561274-project] Calling method '.version_select at 0x7f9f4acb8310>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:29:22.231132 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG dbcounter [-] [117880] Writing DB stats nova_cell0:SELECT=4 {{(pid=117880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:29:22.282036 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG dbcounter [-] [117880] Writing DB stats nova_cell0:SELECT=20 {{(pid=117880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:29:22.295329 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-1a9f6336-7d3d-4a89-80dc-4999f1499680 tempest-VolumesGetTestJSON-1780561274 tempest-VolumesGetTestJSON-1780561274-project] 10.222.0.33 "DELETE /compute/v2.1/os-volumes/3b024e14-4f01-43a8-9420-dc77e5403b76" status: 202 len: 0 microversion: 2.1 time: 0.209663 Jul 18 10:29:22.296852 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 32/61] 10.222.0.33 () {58 vars in 1247 bytes} [Mon Jul 18 10:29:22 2022] DELETE /compute/v2.1/os-volumes/3b024e14-4f01-43a8-9420-dc77e5403b76 => generated 0 bytes in 212 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 18 10:29:22.303549 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-183c6e5a-f452-458d-802f-8d61d9fe4e9c tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:29:22.304519 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-183c6e5a-f452-458d-802f-8d61d9fe4e9c tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] [instance: dcb1b50b-9e62-4ff3-9875-3d4635597b45] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:29:22.317956 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-183c6e5a-f452-458d-802f-8d61d9fe4e9c tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:29:22.319017 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-183c6e5a-f452-458d-802f-8d61d9fe4e9c tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:29:22.321427 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-183c6e5a-f452-458d-802f-8d61d9fe4e9c tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:29:22.322111 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-183c6e5a-f452-458d-802f-8d61d9fe4e9c tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:29:22.497391 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-ffd965ba-f200-4bfc-b669-8286ff3a5bc0 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a431c9708f4694bc0d514133e76088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a1921237622439bab89676e11477c13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:29:22.512882 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-ffd965ba-f200-4bfc-b669-8286ff3a5bc0 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] 10.222.0.33 "GET /compute/v2.1/servers/78bb7f95-9846-4a59-9f77-a3fe69005eec" status: 200 len: 1321 microversion: 2.1 time: 1.354507 Jul 18 10:29:22.520805 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 30/62] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:29:21 2022] GET /compute/v2.1/servers/78bb7f95-9846-4a59-9f77-a3fe69005eec => generated 1321 bytes in 1367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:29:22.545696 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-c1000356-23c7-4e75-970f-936bf5b84840 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:29:22.553431 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-183c6e5a-f452-458d-802f-8d61d9fe4e9c tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '986f90dfbad14324b3fffbd790d60a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e487deb7ff45bdbf2cc002d42d12a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:29:22.553920 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-c1000356-23c7-4e75-970f-936bf5b84840 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] [instance: db62c05e-28a8-4121-a6e5-8abb802f7a17] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:29:22.563464 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-183c6e5a-f452-458d-802f-8d61d9fe4e9c tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] 10.222.0.33 "GET /compute/v2.1/servers/dcb1b50b-9e62-4ff3-9875-3d4635597b45" status: 200 len: 1294 microversion: 2.1 time: 0.265347 Jul 18 10:29:22.581344 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 33/63] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:29:22 2022] GET /compute/v2.1/servers/dcb1b50b-9e62-4ff3-9875-3d4635597b45 => generated 1294 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:29:22.592592 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-c1000356-23c7-4e75-970f-936bf5b84840 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:29:22.593093 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-c1000356-23c7-4e75-970f-936bf5b84840 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:29:22.593691 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-ca8cfee0-7f81-476d-9f0b-161d0d034963 tempest-VolumesGetTestJSON-1780561274 tempest-VolumesGetTestJSON-1780561274-project] Calling method '.version_select at 0x7f9f4accfdc0>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:29:22.600920 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-c1000356-23c7-4e75-970f-936bf5b84840 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:29:22.605674 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-c1000356-23c7-4e75-970f-936bf5b84840 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:29:22.772635 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-ca8cfee0-7f81-476d-9f0b-161d0d034963 tempest-VolumesGetTestJSON-1780561274 tempest-VolumesGetTestJSON-1780561274-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/3b024e14-4f01-43a8-9420-dc77e5403b76" status: 200 len: 351 microversion: 2.1 time: 0.188571 Jul 18 10:29:22.773465 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 34/64] 10.222.0.33 () {58 vars in 1244 bytes} [Mon Jul 18 10:29:22 2022] GET /compute/v2.1/os-volumes/3b024e14-4f01-43a8-9420-dc77e5403b76 => generated 351 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:29:22.884413 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG dbcounter [-] [117879] Writing DB stats nova_cell0:SELECT=6 {{(pid=117879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:29:22.891143 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-d2600295-0ce2-458b-8cbb-7038213c3ccf tempest-DeleteServersTestJSON-1052419078 tempest-DeleteServersTestJSON-1052419078-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:29:22.891849 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-d2600295-0ce2-458b-8cbb-7038213c3ccf tempest-DeleteServersTestJSON-1052419078 tempest-DeleteServersTestJSON-1052419078-project] [instance: df938010-ebc5-429f-8499-4b55eff7cab9] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:29:22.907882 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-d2600295-0ce2-458b-8cbb-7038213c3ccf tempest-DeleteServersTestJSON-1052419078 tempest-DeleteServersTestJSON-1052419078-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:29:22.907882 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-d2600295-0ce2-458b-8cbb-7038213c3ccf tempest-DeleteServersTestJSON-1052419078 tempest-DeleteServersTestJSON-1052419078-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:29:22.907882 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-d2600295-0ce2-458b-8cbb-7038213c3ccf tempest-DeleteServersTestJSON-1052419078 tempest-DeleteServersTestJSON-1052419078-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:29:22.907882 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-d2600295-0ce2-458b-8cbb-7038213c3ccf tempest-DeleteServersTestJSON-1052419078 tempest-DeleteServersTestJSON-1052419078-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:29:23.260256 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-d2600295-0ce2-458b-8cbb-7038213c3ccf tempest-DeleteServersTestJSON-1052419078 tempest-DeleteServersTestJSON-1052419078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0f993e44c624f65abae22540ce7dffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daab623e57e54081b262d4a8fe124f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:29:23.277897 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-d2600295-0ce2-458b-8cbb-7038213c3ccf tempest-DeleteServersTestJSON-1052419078 tempest-DeleteServersTestJSON-1052419078-project] 10.222.0.33 "GET /compute/v2.1/servers/df938010-ebc5-429f-8499-4b55eff7cab9" status: 200 len: 1273 microversion: 2.1 time: 0.395363 Jul 18 10:29:23.280303 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 35/65] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:29:22 2022] GET /compute/v2.1/servers/df938010-ebc5-429f-8499-4b55eff7cab9 => generated 1273 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:29:23.548930 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-77cacc77-78c9-47c4-b6c2-0d8d1a0cc24b tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:29:23.549501 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-77cacc77-78c9-47c4-b6c2-0d8d1a0cc24b tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] [instance: 78bb7f95-9846-4a59-9f77-a3fe69005eec] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:29:23.565696 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-77cacc77-78c9-47c4-b6c2-0d8d1a0cc24b tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:29:23.567198 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-77cacc77-78c9-47c4-b6c2-0d8d1a0cc24b tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:29:23.570355 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-77cacc77-78c9-47c4-b6c2-0d8d1a0cc24b tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:29:23.570864 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-77cacc77-78c9-47c4-b6c2-0d8d1a0cc24b tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:29:23.595672 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-c1000356-23c7-4e75-970f-936bf5b84840 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f25c72896a2d4d619e5ad4b5a0a79aa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cf3d5bfe9a745f38372c42c9cfa1f63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:29:23.656655 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-c1000356-23c7-4e75-970f-936bf5b84840 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] 10.222.0.33 "GET /compute/v2.1/servers/db62c05e-28a8-4121-a6e5-8abb802f7a17" status: 200 len: 1366 microversion: 2.1 time: 1.134363 Jul 18 10:29:23.664306 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 31/66] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:29:22 2022] GET /compute/v2.1/servers/db62c05e-28a8-4121-a6e5-8abb802f7a17 => generated 1366 bytes in 1143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:29:23.696046 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-749e4da2-899f-46f2-aa54-c12fd269bba0 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:29:23.697104 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-749e4da2-899f-46f2-aa54-c12fd269bba0 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] [instance: dcb1b50b-9e62-4ff3-9875-3d4635597b45] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:29:23.730957 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG dbcounter [-] [117879] Writing DB stats nova_cell0:SELECT=28 {{(pid=117879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:29:23.733761 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-749e4da2-899f-46f2-aa54-c12fd269bba0 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:29:23.734455 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-749e4da2-899f-46f2-aa54-c12fd269bba0 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:29:23.737397 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-749e4da2-899f-46f2-aa54-c12fd269bba0 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:29:23.737915 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-749e4da2-899f-46f2-aa54-c12fd269bba0 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:29:24.155512 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-749e4da2-899f-46f2-aa54-c12fd269bba0 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '986f90dfbad14324b3fffbd790d60a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e487deb7ff45bdbf2cc002d42d12a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:29:24.183954 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-749e4da2-899f-46f2-aa54-c12fd269bba0 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] 10.222.0.33 "GET /compute/v2.1/servers/dcb1b50b-9e62-4ff3-9875-3d4635597b45" status: 200 len: 1294 microversion: 2.1 time: 0.512619 Jul 18 10:29:24.187199 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 32/67] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:29:23 2022] GET /compute/v2.1/servers/dcb1b50b-9e62-4ff3-9875-3d4635597b45 => generated 1294 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:29:24.210038 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-074f437c-f01d-4fba-90d2-a1db89f732ea tempest-VolumesGetTestJSON-1780561274 tempest-VolumesGetTestJSON-1780561274-project] Calling method '.version_select at 0x7f9f4b5845e0>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:29:24.431572 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-074f437c-f01d-4fba-90d2-a1db89f732ea tempest-VolumesGetTestJSON-1780561274 tempest-VolumesGetTestJSON-1780561274-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/3b024e14-4f01-43a8-9420-dc77e5403b76" status: 200 len: 351 microversion: 2.1 time: 0.228381 Jul 18 10:29:24.432279 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 33/68] 10.222.0.33 () {58 vars in 1244 bytes} [Mon Jul 18 10:29:24 2022] GET /compute/v2.1/os-volumes/3b024e14-4f01-43a8-9420-dc77e5403b76 => generated 351 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:29:24.442152 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-75c89457-616b-4cde-998f-a2c836798c5f tempest-DeleteServersTestJSON-1052419078 tempest-DeleteServersTestJSON-1052419078-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:29:24.443018 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-75c89457-616b-4cde-998f-a2c836798c5f tempest-DeleteServersTestJSON-1052419078 tempest-DeleteServersTestJSON-1052419078-project] [instance: df938010-ebc5-429f-8499-4b55eff7cab9] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:29:24.451537 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-75c89457-616b-4cde-998f-a2c836798c5f tempest-DeleteServersTestJSON-1052419078 tempest-DeleteServersTestJSON-1052419078-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:29:24.452217 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-75c89457-616b-4cde-998f-a2c836798c5f tempest-DeleteServersTestJSON-1052419078 tempest-DeleteServersTestJSON-1052419078-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:29:24.453236 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-75c89457-616b-4cde-998f-a2c836798c5f tempest-DeleteServersTestJSON-1052419078 tempest-DeleteServersTestJSON-1052419078-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:29:24.454061 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-75c89457-616b-4cde-998f-a2c836798c5f tempest-DeleteServersTestJSON-1052419078 tempest-DeleteServersTestJSON-1052419078-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:29:24.607821 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-77cacc77-78c9-47c4-b6c2-0d8d1a0cc24b tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a431c9708f4694bc0d514133e76088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a1921237622439bab89676e11477c13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:29:24.618497 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-77cacc77-78c9-47c4-b6c2-0d8d1a0cc24b tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] 10.222.0.33 "GET /compute/v2.1/servers/78bb7f95-9846-4a59-9f77-a3fe69005eec" status: 200 len: 1321 microversion: 2.1 time: 1.081052 Jul 18 10:29:24.623514 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 36/69] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:29:23 2022] GET /compute/v2.1/servers/78bb7f95-9846-4a59-9f77-a3fe69005eec => generated 1321 bytes in 1090 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:29:24.810681 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [req-573b2c86-0c15-431e-99a0-faecd49f9066 req-085ebf86-1001-42ee-9107-7a0cf1ac50e8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "591fab72-3729-4b6f-af75-cc55766b7eae", "tag": "3380728a-d068-450d-b0c7-feb491a61db5"}]} {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:29:24.833036 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG dbcounter [-] [117879] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=117879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:29:24.837846 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [req-573b2c86-0c15-431e-99a0-faecd49f9066 req-085ebf86-1001-42ee-9107-7a0cf1ac50e8 service nova] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:29:24.841070 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [req-573b2c86-0c15-431e-99a0-faecd49f9066 req-085ebf86-1001-42ee-9107-7a0cf1ac50e8 service nova] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:29:24.915808 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.compute.server_external_events [req-573b2c86-0c15-431e-99a0-faecd49f9066 req-085ebf86-1001-42ee-9107-7a0cf1ac50e8 service nova] Creating event network-changed:3380728a-d068-450d-b0c7-feb491a61db5 for instance 591fab72-3729-4b6f-af75-cc55766b7eae on hv-cinder-83754 Jul 18 10:29:24.918203 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [req-573b2c86-0c15-431e-99a0-faecd49f9066 req-085ebf86-1001-42ee-9107-7a0cf1ac50e8 service nova] Acquired lock "compute-rpcapi-router" {{(pid=117879) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 18 10:29:24.922174 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-23dfd994-a613-4b97-9e20-42c91b455c19 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:29:24.924534 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-23dfd994-a613-4b97-9e20-42c91b455c19 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:29:24.926792 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-23dfd994-a613-4b97-9e20-42c91b455c19 None None] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:29:24.929521 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-23dfd994-a613-4b97-9e20-42c91b455c19 None None] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:29:24.959187 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.compute.rpcapi [None req-23dfd994-a613-4b97-9e20-42c91b455c19 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 18 10:29:24.962287 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-23dfd994-a613-4b97-9e20-42c91b455c19 None None] Releasing lock "compute-rpcapi-router" {{(pid=117879) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 18 10:29:25.002983 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-23dfd994-a613-4b97-9e20-42c91b455c19 None None] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.377744 Jul 18 10:29:25.004609 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 37/70] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jul 18 10:29:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:29:25.011413 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-9cfe3dfe-df0c-4be6-a4e4-c7501411a906 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:29:25.018726 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-9cfe3dfe-df0c-4be6-a4e4-c7501411a906 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] [instance: db62c05e-28a8-4121-a6e5-8abb802f7a17] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:29:25.035417 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-9cfe3dfe-df0c-4be6-a4e4-c7501411a906 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:29:25.038217 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-9cfe3dfe-df0c-4be6-a4e4-c7501411a906 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:29:25.041287 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-9cfe3dfe-df0c-4be6-a4e4-c7501411a906 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:29:25.042122 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-9cfe3dfe-df0c-4be6-a4e4-c7501411a906 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:29:25.807000 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-75c89457-616b-4cde-998f-a2c836798c5f tempest-DeleteServersTestJSON-1052419078 tempest-DeleteServersTestJSON-1052419078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0f993e44c624f65abae22540ce7dffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daab623e57e54081b262d4a8fe124f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:29:25.818700 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-75c89457-616b-4cde-998f-a2c836798c5f tempest-DeleteServersTestJSON-1052419078 tempest-DeleteServersTestJSON-1052419078-project] 10.222.0.33 "GET /compute/v2.1/servers/df938010-ebc5-429f-8499-4b55eff7cab9" status: 200 len: 1315 microversion: 2.1 time: 1.378138 Jul 18 10:29:25.819643 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 34/71] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:29:24 2022] GET /compute/v2.1/servers/df938010-ebc5-429f-8499-4b55eff7cab9 => generated 1315 bytes in 1387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:29:25.861045 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-c28dfdc1-f3c0-45ec-8bec-0ef8e628040a tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:29:25.862163 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-c28dfdc1-f3c0-45ec-8bec-0ef8e628040a tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] [instance: dcb1b50b-9e62-4ff3-9875-3d4635597b45] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:29:25.875269 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-c28dfdc1-f3c0-45ec-8bec-0ef8e628040a tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:29:25.880752 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-c28dfdc1-f3c0-45ec-8bec-0ef8e628040a tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:29:25.881755 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-c28dfdc1-f3c0-45ec-8bec-0ef8e628040a tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:29:25.882337 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-c28dfdc1-f3c0-45ec-8bec-0ef8e628040a tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:29:26.803610 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-9cfe3dfe-df0c-4be6-a4e4-c7501411a906 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f25c72896a2d4d619e5ad4b5a0a79aa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cf3d5bfe9a745f38372c42c9cfa1f63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:29:26.811429 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-9cfe3dfe-df0c-4be6-a4e4-c7501411a906 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] 10.222.0.33 "GET /compute/v2.1/servers/db62c05e-28a8-4121-a6e5-8abb802f7a17" status: 200 len: 1366 microversion: 2.1 time: 1.805510 Jul 18 10:29:26.814934 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 38/72] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:29:25 2022] GET /compute/v2.1/servers/db62c05e-28a8-4121-a6e5-8abb802f7a17 => generated 1366 bytes in 1810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:29:26.828406 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-4e1a4382-790c-4e39-b2da-fe331989c865 tempest-VolumesGetTestJSON-1780561274 tempest-VolumesGetTestJSON-1780561274-project] Calling method '.version_select at 0x7f9f4acb8280>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:29:26.893021 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.wsgi [None req-4e1a4382-790c-4e39-b2da-fe331989c865 tempest-VolumesGetTestJSON-1780561274 tempest-VolumesGetTestJSON-1780561274-project] HTTP exception thrown: Volume 3b024e14-4f01-43a8-9420-dc77e5403b76 could not be found. Jul 18 10:29:26.895257 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-4e1a4382-790c-4e39-b2da-fe331989c865 tempest-VolumesGetTestJSON-1780561274 tempest-VolumesGetTestJSON-1780561274-project] Request method failure captured: Jul 18 10:29:26.895257 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: request: GET /compute/v2.1/os-volumes/3b024e14-4f01-43a8-9420-dc77e5403b76 HTTP/1.1 Jul 18 10:29:26.895257 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: Accept: application/json Jul 18 10:29:26.895257 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: Accept-Encoding: identity Jul 18 10:29:26.895257 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: Connection: close Jul 18 10:29:26.895257 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: Content-Length: 0 Jul 18 10:29:26.895257 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: Content-Type: application/json Jul 18 10:29:26.895257 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: Host: 10.222.0.33 Jul 18 10:29:26.895257 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: Openstack-System-Scope: None Jul 18 10:29:26.895257 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: User-Agent: python-urllib3/1.26.9 Jul 18 10:29:26.895257 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Auth-Token: gAAAAABi1TX-sUe_WxW3AS2lHFxNCXWd-AxAgisYsgF_ZbIktura0iDqnPmqJQxSWrw1V18SEkiBX1dI7IqspKhtjNbcwJ__LgcQvp0UzGRqUUZpExq5ORQnTYWhpi5ETmTyCTiRnCdmZ5undIQrXpvj3J3IAz_0xsctve6cqkw5QcCrwyJHLhM Jul 18 10:29:26.895257 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Domain-Id: None Jul 18 10:29:26.895257 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Domain-Name: None Jul 18 10:29:26.895257 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Identity-Status: Confirmed Jul 18 10:29:26.895257 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Is-Admin-Project: True Jul 18 10:29:26.895257 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Project-Domain-Id: default Jul 18 10:29:26.895257 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Project-Domain-Name: Default Jul 18 10:29:26.895257 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Project-Id: 5919b07a88f246f9bfa38f1f49a446c5 Jul 18 10:29:26.895257 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Project-Name: tempest-VolumesGetTestJSON-1780561274 Jul 18 10:29:26.895257 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Role: member,reader Jul 18 10:29:26.895257 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Roles: member,reader Jul 18 10:29:26.897076 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5919b07a88f246f9bfa38f1f49a446c5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5919b07a88f246f9bfa38f1f49a446c5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/5919b07a88f246f9bfa38f1f49a446c5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_5919b07a88f246f9bfa38f1f49a446c5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jul 18 10:29:26.897076 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Tenant: tempest-VolumesGetTestJSON-1780561274 Jul 18 10:29:26.897076 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Tenant-Id: 5919b07a88f246f9bfa38f1f49a446c5 Jul 18 10:29:26.897076 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Tenant-Name: tempest-VolumesGetTestJSON-1780561274 Jul 18 10:29:26.897076 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-User: tempest-VolumesGetTestJSON-1780561274-project Jul 18 10:29:26.897076 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-User-Domain-Id: default Jul 18 10:29:26.897076 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-User-Domain-Name: Default Jul 18 10:29:26.897076 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-User-Id: 3cad7549c4a546c9897fb98a143fda9c Jul 18 10:29:26.897076 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-User-Name: tempest-VolumesGetTestJSON-1780561274-project Jul 18 10:29:26.897076 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: method: Jul 18 10:29:26.897076 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: exception: Volume 3b024e14-4f01-43a8-9420-dc77e5403b76 could not be found. Jul 18 10:29:26.897076 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: action_args: {'id': '3b024e14-4f01-43a8-9420-dc77e5403b76'} Jul 18 10:29:26.897076 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 10:29:26.897824 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:29:26.897824 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 18 10:29:26.897824 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 18 10:29:26.897824 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 18 10:29:26.897824 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 18 10:29:26.897824 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 18 10:29:26.897824 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 18 10:29:26.897824 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 18 10:29:26.897824 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 18 10:29:26.897824 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 18 10:29:26.897824 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 18 10:29:26.897824 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 18 10:29:26.897824 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 18 10:29:26.897824 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 18 10:29:26.897824 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 18 10:29:26.897824 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 3b024e14-4f01-43a8-9420-dc77e5403b76 could not be found. (HTTP 404) (Request-ID: req-dbec8f81-27e8-4cf4-bfe3-3e02c8f18b86) Jul 18 10:29:26.897824 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi Jul 18 10:29:26.897824 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:29:26.897824 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi Jul 18 10:29:26.899314 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:29:26.899314 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 18 10:29:26.899314 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 18 10:29:26.899314 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 18 10:29:26.899314 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 18 10:29:26.899314 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 18 10:29:26.899314 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 18 10:29:26.899314 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 18 10:29:26.899314 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 18 10:29:26.899314 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 18 10:29:26.899314 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 18 10:29:26.899314 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 18 10:29:26.899314 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 18 10:29:26.899314 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 18 10:29:26.899314 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 18 10:29:26.899314 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 18 10:29:26.899314 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 18 10:29:26.899314 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 18 10:29:26.899314 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 18 10:29:26.903868 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 18 10:29:26.903868 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 18 10:29:26.903868 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 18 10:29:26.903868 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 18 10:29:26.903868 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 3b024e14-4f01-43a8-9420-dc77e5403b76 could not be found. Jul 18 10:29:26.903868 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi Jul 18 10:29:26.903868 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:29:26.903868 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi Jul 18 10:29:26.903868 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:29:26.903868 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:29:26.903868 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:29:26.903868 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 10:29:26.903868 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 10:29:26.903868 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 10:29:26.903868 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 10:29:26.903868 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 10:29:26.903868 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 10:29:26.903868 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 18 10:29:26.903868 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 10:29:26.906883 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 3b024e14-4f01-43a8-9420-dc77e5403b76 could not be found. Jul 18 10:29:26.906883 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi Jul 18 10:29:26.906883 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:29:26.906883 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi Jul 18 10:29:26.906883 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:29:26.906883 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:29:26.906883 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:29:26.906883 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 10:29:26.906883 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 10:29:26.906883 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 3b024e14-4f01-43a8-9420-dc77e5403b76 could not be found. Jul 18 10:29:26.906883 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi Jul 18 10:29:26.906883 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-4e1a4382-790c-4e39-b2da-fe331989c865 tempest-VolumesGetTestJSON-1780561274 tempest-VolumesGetTestJSON-1780561274-project] Returning 404 to user: Volume 3b024e14-4f01-43a8-9420-dc77e5403b76 could not be found. {{(pid=117879) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 10:29:26.906883 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-4e1a4382-790c-4e39-b2da-fe331989c865 tempest-VolumesGetTestJSON-1780561274 tempest-VolumesGetTestJSON-1780561274-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/3b024e14-4f01-43a8-9420-dc77e5403b76" status: 404 len: 109 microversion: 2.1 time: 0.080513 Jul 18 10:29:26.906883 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 39/73] 10.222.0.33 () {58 vars in 1244 bytes} [Mon Jul 18 10:29:26 2022] GET /compute/v2.1/os-volumes/3b024e14-4f01-43a8-9420-dc77e5403b76 => generated 109 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 10:29:26.908655 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-670e404a-7a70-42f9-9ef7-5c3eeac40e8d tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:29:26.908655 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-670e404a-7a70-42f9-9ef7-5c3eeac40e8d tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] [instance: 78bb7f95-9846-4a59-9f77-a3fe69005eec] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:29:26.921740 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-670e404a-7a70-42f9-9ef7-5c3eeac40e8d tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:29:26.933310 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-670e404a-7a70-42f9-9ef7-5c3eeac40e8d tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:29:26.934416 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-670e404a-7a70-42f9-9ef7-5c3eeac40e8d tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:29:26.935050 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-670e404a-7a70-42f9-9ef7-5c3eeac40e8d tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:29:27.198167 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-c28dfdc1-f3c0-45ec-8bec-0ef8e628040a tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '986f90dfbad14324b3fffbd790d60a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e487deb7ff45bdbf2cc002d42d12a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:29:27.211342 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-c28dfdc1-f3c0-45ec-8bec-0ef8e628040a tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] 10.222.0.33 "GET /compute/v2.1/servers/dcb1b50b-9e62-4ff3-9875-3d4635597b45" status: 200 len: 1361 microversion: 2.1 time: 1.367012 Jul 18 10:29:27.211879 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 35/74] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:29:25 2022] GET /compute/v2.1/servers/dcb1b50b-9e62-4ff3-9875-3d4635597b45 => generated 1361 bytes in 1368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:29:27.475446 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-670e404a-7a70-42f9-9ef7-5c3eeac40e8d tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a431c9708f4694bc0d514133e76088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a1921237622439bab89676e11477c13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:29:27.479843 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG dbcounter [-] [117879] Writing DB stats nova_cell1:SELECT=100 {{(pid=117879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:29:27.484550 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-670e404a-7a70-42f9-9ef7-5c3eeac40e8d tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] 10.222.0.33 "GET /compute/v2.1/servers/78bb7f95-9846-4a59-9f77-a3fe69005eec" status: 200 len: 1321 microversion: 2.1 time: 0.582886 Jul 18 10:29:27.505264 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 40/75] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:29:26 2022] GET /compute/v2.1/servers/78bb7f95-9846-4a59-9f77-a3fe69005eec => generated 1321 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:29:27.517737 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-2b0f54cf-86fc-44eb-8590-37be669af065 tempest-DeleteServersTestJSON-1052419078 tempest-DeleteServersTestJSON-1052419078-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:29:27.518632 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-2b0f54cf-86fc-44eb-8590-37be669af065 tempest-DeleteServersTestJSON-1052419078 tempest-DeleteServersTestJSON-1052419078-project] [instance: df938010-ebc5-429f-8499-4b55eff7cab9] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:29:27.537861 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-2b0f54cf-86fc-44eb-8590-37be669af065 tempest-DeleteServersTestJSON-1052419078 tempest-DeleteServersTestJSON-1052419078-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:29:27.537861 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-2b0f54cf-86fc-44eb-8590-37be669af065 tempest-DeleteServersTestJSON-1052419078 tempest-DeleteServersTestJSON-1052419078-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:29:27.538677 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-2b0f54cf-86fc-44eb-8590-37be669af065 tempest-DeleteServersTestJSON-1052419078 tempest-DeleteServersTestJSON-1052419078-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:29:27.539133 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-2b0f54cf-86fc-44eb-8590-37be669af065 tempest-DeleteServersTestJSON-1052419078 tempest-DeleteServersTestJSON-1052419078-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:29:27.609314 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [req-cf11aab5-8d0f-4809-8ab7-f9c8b03d28e5 req-de61314e-ac0c-44fd-b257-51ce8f114273 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "db62c05e-28a8-4121-a6e5-8abb802f7a17", "tag": "f97d9284-09c3-4aa3-8f54-5bb526b9fe08"}]} {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:29:27.657422 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [req-cf11aab5-8d0f-4809-8ab7-f9c8b03d28e5 req-de61314e-ac0c-44fd-b257-51ce8f114273 service nova] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:29:27.661626 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [req-cf11aab5-8d0f-4809-8ab7-f9c8b03d28e5 req-de61314e-ac0c-44fd-b257-51ce8f114273 service nova] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:29:27.727868 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.compute.server_external_events [req-cf11aab5-8d0f-4809-8ab7-f9c8b03d28e5 req-de61314e-ac0c-44fd-b257-51ce8f114273 service nova] Creating event network-changed:f97d9284-09c3-4aa3-8f54-5bb526b9fe08 for instance db62c05e-28a8-4121-a6e5-8abb802f7a17 on hv-cinder-83754 Jul 18 10:29:27.730607 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [req-cf11aab5-8d0f-4809-8ab7-f9c8b03d28e5 req-de61314e-ac0c-44fd-b257-51ce8f114273 service nova] Acquired lock "compute-rpcapi-router" {{(pid=117880) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 18 10:29:27.733836 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-a5bcb417-207b-4c1f-a700-2067f7ee28f2 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:29:27.734451 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-a5bcb417-207b-4c1f-a700-2067f7ee28f2 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:29:27.737379 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-a5bcb417-207b-4c1f-a700-2067f7ee28f2 None None] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:29:27.738115 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-a5bcb417-207b-4c1f-a700-2067f7ee28f2 None None] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:29:27.766992 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.compute.rpcapi [None req-a5bcb417-207b-4c1f-a700-2067f7ee28f2 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 18 10:29:27.771200 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-a5bcb417-207b-4c1f-a700-2067f7ee28f2 None None] Releasing lock "compute-rpcapi-router" {{(pid=117880) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 18 10:29:27.812135 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-a5bcb417-207b-4c1f-a700-2067f7ee28f2 None None] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.598992 Jul 18 10:29:27.814032 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 36/76] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jul 18 10:29:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:29:27.835320 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [req-63873c9f-3eee-4c55-88a8-19a8a027970a req-7592d9eb-53e0-48a7-808f-71b810104c40 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "78bb7f95-9846-4a59-9f77-a3fe69005eec", "tag": "13cc5a6d-eabb-457d-adf0-12b5abac3083"}]} {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:29:27.874306 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [req-63873c9f-3eee-4c55-88a8-19a8a027970a req-7592d9eb-53e0-48a7-808f-71b810104c40 service nova] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:29:27.875271 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [req-63873c9f-3eee-4c55-88a8-19a8a027970a req-7592d9eb-53e0-48a7-808f-71b810104c40 service nova] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:29:27.896581 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.compute.server_external_events [req-63873c9f-3eee-4c55-88a8-19a8a027970a req-7592d9eb-53e0-48a7-808f-71b810104c40 service nova] Creating event network-changed:13cc5a6d-eabb-457d-adf0-12b5abac3083 for instance 78bb7f95-9846-4a59-9f77-a3fe69005eec on hv-cinder-83754 Jul 18 10:29:27.906061 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [req-63873c9f-3eee-4c55-88a8-19a8a027970a req-7592d9eb-53e0-48a7-808f-71b810104c40 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088676 Jul 18 10:29:27.908153 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 37/77] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jul 18 10:29:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:29:27.927448 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-b86b0dcf-a475-43e0-a6c6-1ab44fd8d8aa tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:29:27.928447 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-b86b0dcf-a475-43e0-a6c6-1ab44fd8d8aa tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] [instance: db62c05e-28a8-4121-a6e5-8abb802f7a17] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:29:27.954759 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-b86b0dcf-a475-43e0-a6c6-1ab44fd8d8aa tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:29:27.955957 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-b86b0dcf-a475-43e0-a6c6-1ab44fd8d8aa tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:29:27.958120 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-b86b0dcf-a475-43e0-a6c6-1ab44fd8d8aa tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:29:27.958735 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-b86b0dcf-a475-43e0-a6c6-1ab44fd8d8aa tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:29:28.746845 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-2b0f54cf-86fc-44eb-8590-37be669af065 tempest-DeleteServersTestJSON-1052419078 tempest-DeleteServersTestJSON-1052419078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0f993e44c624f65abae22540ce7dffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daab623e57e54081b262d4a8fe124f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:29:28.773495 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-2b0f54cf-86fc-44eb-8590-37be669af065 tempest-DeleteServersTestJSON-1052419078 tempest-DeleteServersTestJSON-1052419078-project] 10.222.0.33 "GET /compute/v2.1/servers/df938010-ebc5-429f-8499-4b55eff7cab9" status: 200 len: 1315 microversion: 2.1 time: 1.260633 Jul 18 10:29:28.789277 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 41/78] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:29:27 2022] GET /compute/v2.1/servers/df938010-ebc5-429f-8499-4b55eff7cab9 => generated 1315 bytes in 1283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:29:28.801501 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-17c0ae74-9836-4815-a79e-37d5471f4a08 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:29:28.804425 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-17c0ae74-9836-4815-a79e-37d5471f4a08 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] [instance: dcb1b50b-9e62-4ff3-9875-3d4635597b45] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:29:28.835124 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-17c0ae74-9836-4815-a79e-37d5471f4a08 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:29:28.845403 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-17c0ae74-9836-4815-a79e-37d5471f4a08 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:29:28.846568 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-17c0ae74-9836-4815-a79e-37d5471f4a08 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:29:28.847239 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-17c0ae74-9836-4815-a79e-37d5471f4a08 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:29:29.120925 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-b86b0dcf-a475-43e0-a6c6-1ab44fd8d8aa tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f25c72896a2d4d619e5ad4b5a0a79aa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cf3d5bfe9a745f38372c42c9cfa1f63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:29:29.131309 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG dbcounter [-] [117880] Writing DB stats nova_cell1:SELECT=100 {{(pid=117880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:29:29.157967 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-b86b0dcf-a475-43e0-a6c6-1ab44fd8d8aa tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] 10.222.0.33 "GET /compute/v2.1/servers/db62c05e-28a8-4121-a6e5-8abb802f7a17" status: 200 len: 1366 microversion: 2.1 time: 1.241904 Jul 18 10:29:29.161922 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 38/79] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:29:27 2022] GET /compute/v2.1/servers/db62c05e-28a8-4121-a6e5-8abb802f7a17 => generated 1366 bytes in 1253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:29:29.173762 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-8f2a4139-f4ba-498d-b39d-edca6465c07a tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:29:29.174292 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-8f2a4139-f4ba-498d-b39d-edca6465c07a tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] [instance: 78bb7f95-9846-4a59-9f77-a3fe69005eec] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:29:29.194857 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-8f2a4139-f4ba-498d-b39d-edca6465c07a tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:29:29.195400 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-8f2a4139-f4ba-498d-b39d-edca6465c07a tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:29:29.196753 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-8f2a4139-f4ba-498d-b39d-edca6465c07a tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:29:29.198273 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-8f2a4139-f4ba-498d-b39d-edca6465c07a tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:29:30.343212 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-8f2a4139-f4ba-498d-b39d-edca6465c07a tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a431c9708f4694bc0d514133e76088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a1921237622439bab89676e11477c13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:29:30.354671 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-8f2a4139-f4ba-498d-b39d-edca6465c07a tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] 10.222.0.33 "GET /compute/v2.1/servers/78bb7f95-9846-4a59-9f77-a3fe69005eec" status: 200 len: 1321 microversion: 2.1 time: 1.191371 Jul 18 10:29:30.355484 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 39/80] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:29:29 2022] GET /compute/v2.1/servers/78bb7f95-9846-4a59-9f77-a3fe69005eec => generated 1321 bytes in 1193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:29:30.373431 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-0e156a47-5dbd-45d9-a526-738a037e7b56 tempest-DeleteServersTestJSON-1052419078 tempest-DeleteServersTestJSON-1052419078-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:29:30.376652 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-0e156a47-5dbd-45d9-a526-738a037e7b56 tempest-DeleteServersTestJSON-1052419078 tempest-DeleteServersTestJSON-1052419078-project] [instance: df938010-ebc5-429f-8499-4b55eff7cab9] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:29:30.377171 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-17c0ae74-9836-4815-a79e-37d5471f4a08 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '986f90dfbad14324b3fffbd790d60a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e487deb7ff45bdbf2cc002d42d12a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:29:30.389737 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-0e156a47-5dbd-45d9-a526-738a037e7b56 tempest-DeleteServersTestJSON-1052419078 tempest-DeleteServersTestJSON-1052419078-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:29:30.390449 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-0e156a47-5dbd-45d9-a526-738a037e7b56 tempest-DeleteServersTestJSON-1052419078 tempest-DeleteServersTestJSON-1052419078-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:29:30.392135 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-0e156a47-5dbd-45d9-a526-738a037e7b56 tempest-DeleteServersTestJSON-1052419078 tempest-DeleteServersTestJSON-1052419078-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:29:30.392608 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-0e156a47-5dbd-45d9-a526-738a037e7b56 tempest-DeleteServersTestJSON-1052419078 tempest-DeleteServersTestJSON-1052419078-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:29:30.404434 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-17c0ae74-9836-4815-a79e-37d5471f4a08 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] 10.222.0.33 "GET /compute/v2.1/servers/dcb1b50b-9e62-4ff3-9875-3d4635597b45" status: 200 len: 1361 microversion: 2.1 time: 1.610778 Jul 18 10:29:30.405481 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 42/81] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:29:28 2022] GET /compute/v2.1/servers/dcb1b50b-9e62-4ff3-9875-3d4635597b45 => generated 1361 bytes in 1615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:29:30.417806 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [req-35474e0c-f099-48a4-af64-2b811a794ada req-9e15438b-4000-4240-8972-cfa1a83f84c3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "df938010-ebc5-429f-8499-4b55eff7cab9", "tag": "b4d3e21d-6206-4ae8-99b7-004371bb68f2"}]} {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:29:30.432888 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [req-35474e0c-f099-48a4-af64-2b811a794ada req-9e15438b-4000-4240-8972-cfa1a83f84c3 service nova] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:29:30.433342 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [req-35474e0c-f099-48a4-af64-2b811a794ada req-9e15438b-4000-4240-8972-cfa1a83f84c3 service nova] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:29:30.459746 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.compute.server_external_events [req-35474e0c-f099-48a4-af64-2b811a794ada req-9e15438b-4000-4240-8972-cfa1a83f84c3 service nova] Creating event network-changed:b4d3e21d-6206-4ae8-99b7-004371bb68f2 for instance df938010-ebc5-429f-8499-4b55eff7cab9 on hv-cinder-83754 Jul 18 10:29:30.465025 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [req-35474e0c-f099-48a4-af64-2b811a794ada req-9e15438b-4000-4240-8972-cfa1a83f84c3 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058333 Jul 18 10:29:30.466076 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 43/82] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jul 18 10:29:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:29:30.472427 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-fc5f2528-db8e-4a1c-ab28-fce614d7eff4 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:29:30.474972 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-fc5f2528-db8e-4a1c-ab28-fce614d7eff4 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] [instance: db62c05e-28a8-4121-a6e5-8abb802f7a17] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:29:30.485689 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-fc5f2528-db8e-4a1c-ab28-fce614d7eff4 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:29:30.486153 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-fc5f2528-db8e-4a1c-ab28-fce614d7eff4 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:29:30.486939 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-fc5f2528-db8e-4a1c-ab28-fce614d7eff4 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:29:30.487383 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-fc5f2528-db8e-4a1c-ab28-fce614d7eff4 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:29:30.996995 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-fc5f2528-db8e-4a1c-ab28-fce614d7eff4 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f25c72896a2d4d619e5ad4b5a0a79aa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cf3d5bfe9a745f38372c42c9cfa1f63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:29:31.009639 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-fc5f2528-db8e-4a1c-ab28-fce614d7eff4 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] 10.222.0.33 "GET /compute/v2.1/servers/db62c05e-28a8-4121-a6e5-8abb802f7a17" status: 200 len: 1366 microversion: 2.1 time: 0.542190 Jul 18 10:29:31.023655 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 44/83] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:29:30 2022] GET /compute/v2.1/servers/db62c05e-28a8-4121-a6e5-8abb802f7a17 => generated 1366 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:29:31.070636 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-0e156a47-5dbd-45d9-a526-738a037e7b56 tempest-DeleteServersTestJSON-1052419078 tempest-DeleteServersTestJSON-1052419078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0f993e44c624f65abae22540ce7dffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daab623e57e54081b262d4a8fe124f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:29:31.080224 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-0e156a47-5dbd-45d9-a526-738a037e7b56 tempest-DeleteServersTestJSON-1052419078 tempest-DeleteServersTestJSON-1052419078-project] 10.222.0.33 "GET /compute/v2.1/servers/df938010-ebc5-429f-8499-4b55eff7cab9" status: 200 len: 1315 microversion: 2.1 time: 0.723507 Jul 18 10:29:31.083329 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 40/84] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:29:30 2022] GET /compute/v2.1/servers/df938010-ebc5-429f-8499-4b55eff7cab9 => generated 1315 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:29:31.372314 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-ce1ec36d-1e52-46e5-9649-abdaf25f5f48 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:29:31.372959 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-ce1ec36d-1e52-46e5-9649-abdaf25f5f48 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] [instance: 78bb7f95-9846-4a59-9f77-a3fe69005eec] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:29:31.379486 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-ce1ec36d-1e52-46e5-9649-abdaf25f5f48 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:29:31.380091 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-ce1ec36d-1e52-46e5-9649-abdaf25f5f48 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:29:31.380980 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-ce1ec36d-1e52-46e5-9649-abdaf25f5f48 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:29:31.381279 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-ce1ec36d-1e52-46e5-9649-abdaf25f5f48 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:29:31.422702 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-412a9462-0687-4f5f-a3a4-a067b2e2bec6 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:29:31.423469 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-412a9462-0687-4f5f-a3a4-a067b2e2bec6 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] [instance: dcb1b50b-9e62-4ff3-9875-3d4635597b45] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:29:31.426292 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG dbcounter [-] [117880] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=8 {{(pid=117880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:29:31.435004 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-412a9462-0687-4f5f-a3a4-a067b2e2bec6 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:29:31.435461 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-412a9462-0687-4f5f-a3a4-a067b2e2bec6 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:29:31.436246 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-412a9462-0687-4f5f-a3a4-a067b2e2bec6 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:29:31.436705 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-412a9462-0687-4f5f-a3a4-a067b2e2bec6 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:29:31.590433 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-ce1ec36d-1e52-46e5-9649-abdaf25f5f48 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a431c9708f4694bc0d514133e76088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a1921237622439bab89676e11477c13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:29:31.601269 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-ce1ec36d-1e52-46e5-9649-abdaf25f5f48 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] 10.222.0.33 "GET /compute/v2.1/servers/78bb7f95-9846-4a59-9f77-a3fe69005eec" status: 200 len: 1321 microversion: 2.1 time: 0.232421 Jul 18 10:29:31.602477 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 45/85] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:29:31 2022] GET /compute/v2.1/servers/78bb7f95-9846-4a59-9f77-a3fe69005eec => generated 1321 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:29:31.618999 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-412a9462-0687-4f5f-a3a4-a067b2e2bec6 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '986f90dfbad14324b3fffbd790d60a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e487deb7ff45bdbf2cc002d42d12a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:29:31.627306 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-412a9462-0687-4f5f-a3a4-a067b2e2bec6 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] 10.222.0.33 "GET /compute/v2.1/servers/dcb1b50b-9e62-4ff3-9875-3d4635597b45" status: 200 len: 1361 microversion: 2.1 time: 0.208590 Jul 18 10:29:31.628168 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 41/86] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:29:31 2022] GET /compute/v2.1/servers/dcb1b50b-9e62-4ff3-9875-3d4635597b45 => generated 1361 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:29:32.027317 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-aa62f1af-136a-4dd6-aca9-4637d81a1c80 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:29:32.027959 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-aa62f1af-136a-4dd6-aca9-4637d81a1c80 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] [instance: db62c05e-28a8-4121-a6e5-8abb802f7a17] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:29:32.050984 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-aa62f1af-136a-4dd6-aca9-4637d81a1c80 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:29:32.054105 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-aa62f1af-136a-4dd6-aca9-4637d81a1c80 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:29:32.055037 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-aa62f1af-136a-4dd6-aca9-4637d81a1c80 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:29:32.060862 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-aa62f1af-136a-4dd6-aca9-4637d81a1c80 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:29:32.100727 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-68ecedce-26fb-4fd9-8fd0-f2a37cba1c6a tempest-DeleteServersTestJSON-1052419078 tempest-DeleteServersTestJSON-1052419078-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:29:32.101436 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-68ecedce-26fb-4fd9-8fd0-f2a37cba1c6a tempest-DeleteServersTestJSON-1052419078 tempest-DeleteServersTestJSON-1052419078-project] [instance: df938010-ebc5-429f-8499-4b55eff7cab9] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:29:32.110743 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-68ecedce-26fb-4fd9-8fd0-f2a37cba1c6a tempest-DeleteServersTestJSON-1052419078 tempest-DeleteServersTestJSON-1052419078-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:29:32.116312 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-68ecedce-26fb-4fd9-8fd0-f2a37cba1c6a tempest-DeleteServersTestJSON-1052419078 tempest-DeleteServersTestJSON-1052419078-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:29:32.117310 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-68ecedce-26fb-4fd9-8fd0-f2a37cba1c6a tempest-DeleteServersTestJSON-1052419078 tempest-DeleteServersTestJSON-1052419078-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:29:32.117820 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-68ecedce-26fb-4fd9-8fd0-f2a37cba1c6a tempest-DeleteServersTestJSON-1052419078 tempest-DeleteServersTestJSON-1052419078-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:29:32.366122 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-aa62f1af-136a-4dd6-aca9-4637d81a1c80 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f25c72896a2d4d619e5ad4b5a0a79aa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cf3d5bfe9a745f38372c42c9cfa1f63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:29:32.375249 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-aa62f1af-136a-4dd6-aca9-4637d81a1c80 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] 10.222.0.33 "GET /compute/v2.1/servers/db62c05e-28a8-4121-a6e5-8abb802f7a17" status: 200 len: 1366 microversion: 2.1 time: 0.351639 Jul 18 10:29:32.375681 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-68ecedce-26fb-4fd9-8fd0-f2a37cba1c6a tempest-DeleteServersTestJSON-1052419078 tempest-DeleteServersTestJSON-1052419078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0f993e44c624f65abae22540ce7dffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daab623e57e54081b262d4a8fe124f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:29:32.388226 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 46/87] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:29:32 2022] GET /compute/v2.1/servers/db62c05e-28a8-4121-a6e5-8abb802f7a17 => generated 1366 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:29:32.401926 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-68ecedce-26fb-4fd9-8fd0-f2a37cba1c6a tempest-DeleteServersTestJSON-1052419078 tempest-DeleteServersTestJSON-1052419078-project] 10.222.0.33 "GET /compute/v2.1/servers/df938010-ebc5-429f-8499-4b55eff7cab9" status: 200 len: 1315 microversion: 2.1 time: 0.305970 Jul 18 10:29:32.403152 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 42/88] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:29:32 2022] GET /compute/v2.1/servers/df938010-ebc5-429f-8499-4b55eff7cab9 => generated 1315 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:29:32.510044 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [req-93007318-7e36-4e22-bbc7-12a504b76531 req-00762bb0-e31e-4b85-9f8a-2d9dea9096a7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dcb1b50b-9e62-4ff3-9875-3d4635597b45", "tag": "2be9cb89-71c6-44bf-b559-2446d61bca60"}]} {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:29:32.518678 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [req-93007318-7e36-4e22-bbc7-12a504b76531 req-00762bb0-e31e-4b85-9f8a-2d9dea9096a7 service nova] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:29:32.519125 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [req-93007318-7e36-4e22-bbc7-12a504b76531 req-00762bb0-e31e-4b85-9f8a-2d9dea9096a7 service nova] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:29:32.546068 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.compute.server_external_events [req-93007318-7e36-4e22-bbc7-12a504b76531 req-00762bb0-e31e-4b85-9f8a-2d9dea9096a7 service nova] Creating event network-changed:2be9cb89-71c6-44bf-b559-2446d61bca60 for instance dcb1b50b-9e62-4ff3-9875-3d4635597b45 on hv-cinder-83754 Jul 18 10:29:32.555744 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [req-93007318-7e36-4e22-bbc7-12a504b76531 req-00762bb0-e31e-4b85-9f8a-2d9dea9096a7 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048541 Jul 18 10:29:32.560998 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 47/89] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jul 18 10:29:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:29:32.621969 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-d8ce2dac-028d-4b40-9f07-846d4d4d8a04 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:29:32.625100 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-d8ce2dac-028d-4b40-9f07-846d4d4d8a04 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] [instance: 78bb7f95-9846-4a59-9f77-a3fe69005eec] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:29:32.646798 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-0daf5721-dbb2-47e6-a09e-e8e88140803c tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:29:32.648079 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-0daf5721-dbb2-47e6-a09e-e8e88140803c tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] [instance: dcb1b50b-9e62-4ff3-9875-3d4635597b45] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:29:32.654498 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-d8ce2dac-028d-4b40-9f07-846d4d4d8a04 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:29:32.655469 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-d8ce2dac-028d-4b40-9f07-846d4d4d8a04 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:29:32.656455 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-d8ce2dac-028d-4b40-9f07-846d4d4d8a04 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:29:32.657242 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-d8ce2dac-028d-4b40-9f07-846d4d4d8a04 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:29:32.662093 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-0daf5721-dbb2-47e6-a09e-e8e88140803c tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:29:32.662574 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-0daf5721-dbb2-47e6-a09e-e8e88140803c tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:29:32.664694 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-0daf5721-dbb2-47e6-a09e-e8e88140803c tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:29:32.666505 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-0daf5721-dbb2-47e6-a09e-e8e88140803c tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:29:33.101699 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-0daf5721-dbb2-47e6-a09e-e8e88140803c tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '986f90dfbad14324b3fffbd790d60a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e487deb7ff45bdbf2cc002d42d12a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:29:33.111302 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-0daf5721-dbb2-47e6-a09e-e8e88140803c tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] 10.222.0.33 "GET /compute/v2.1/servers/dcb1b50b-9e62-4ff3-9875-3d4635597b45" status: 200 len: 1361 microversion: 2.1 time: 0.470122 Jul 18 10:29:33.111881 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 48/90] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:29:32 2022] GET /compute/v2.1/servers/dcb1b50b-9e62-4ff3-9875-3d4635597b45 => generated 1361 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:29:33.157468 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-d8ce2dac-028d-4b40-9f07-846d4d4d8a04 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a431c9708f4694bc0d514133e76088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a1921237622439bab89676e11477c13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:29:33.173487 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-d8ce2dac-028d-4b40-9f07-846d4d4d8a04 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] 10.222.0.33 "GET /compute/v2.1/servers/78bb7f95-9846-4a59-9f77-a3fe69005eec" status: 200 len: 1321 microversion: 2.1 time: 0.557810 Jul 18 10:29:33.175499 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 43/91] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:29:32 2022] GET /compute/v2.1/servers/78bb7f95-9846-4a59-9f77-a3fe69005eec => generated 1321 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:29:33.394804 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-6f165b76-7271-425a-a4c8-fda9bb93f79a tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:29:33.396432 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-6f165b76-7271-425a-a4c8-fda9bb93f79a tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] [instance: db62c05e-28a8-4121-a6e5-8abb802f7a17] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:29:33.406084 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-6f165b76-7271-425a-a4c8-fda9bb93f79a tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:29:33.410720 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-6f165b76-7271-425a-a4c8-fda9bb93f79a tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:29:33.411834 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-6f165b76-7271-425a-a4c8-fda9bb93f79a tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:29:33.415371 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-6f165b76-7271-425a-a4c8-fda9bb93f79a tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:29:33.420371 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-00137457-35ac-4285-8c72-180c6da04137 tempest-DeleteServersTestJSON-1052419078 tempest-DeleteServersTestJSON-1052419078-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:29:33.421355 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-00137457-35ac-4285-8c72-180c6da04137 tempest-DeleteServersTestJSON-1052419078 tempest-DeleteServersTestJSON-1052419078-project] [instance: df938010-ebc5-429f-8499-4b55eff7cab9] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:29:33.435666 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-00137457-35ac-4285-8c72-180c6da04137 tempest-DeleteServersTestJSON-1052419078 tempest-DeleteServersTestJSON-1052419078-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:29:33.436342 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-00137457-35ac-4285-8c72-180c6da04137 tempest-DeleteServersTestJSON-1052419078 tempest-DeleteServersTestJSON-1052419078-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:29:33.438173 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-00137457-35ac-4285-8c72-180c6da04137 tempest-DeleteServersTestJSON-1052419078 tempest-DeleteServersTestJSON-1052419078-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:29:33.441517 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-00137457-35ac-4285-8c72-180c6da04137 tempest-DeleteServersTestJSON-1052419078 tempest-DeleteServersTestJSON-1052419078-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:29:34.510253 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-6f165b76-7271-425a-a4c8-fda9bb93f79a tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f25c72896a2d4d619e5ad4b5a0a79aa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cf3d5bfe9a745f38372c42c9cfa1f63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:29:34.522392 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-6f165b76-7271-425a-a4c8-fda9bb93f79a tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] 10.222.0.33 "GET /compute/v2.1/servers/db62c05e-28a8-4121-a6e5-8abb802f7a17" status: 200 len: 1366 microversion: 2.1 time: 1.131769 Jul 18 10:29:34.523310 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 49/92] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:29:33 2022] GET /compute/v2.1/servers/db62c05e-28a8-4121-a6e5-8abb802f7a17 => generated 1366 bytes in 1133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:29:34.529278 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-a401437e-6deb-4ed9-88f7-fb08e47c2560 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:29:34.530543 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-a401437e-6deb-4ed9-88f7-fb08e47c2560 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] [instance: dcb1b50b-9e62-4ff3-9875-3d4635597b45] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:29:34.540140 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-a401437e-6deb-4ed9-88f7-fb08e47c2560 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:29:34.541191 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-a401437e-6deb-4ed9-88f7-fb08e47c2560 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:29:34.542818 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-a401437e-6deb-4ed9-88f7-fb08e47c2560 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:29:34.544241 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-a401437e-6deb-4ed9-88f7-fb08e47c2560 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:29:34.557521 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-00137457-35ac-4285-8c72-180c6da04137 tempest-DeleteServersTestJSON-1052419078 tempest-DeleteServersTestJSON-1052419078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0f993e44c624f65abae22540ce7dffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daab623e57e54081b262d4a8fe124f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:29:34.586251 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-00137457-35ac-4285-8c72-180c6da04137 tempest-DeleteServersTestJSON-1052419078 tempest-DeleteServersTestJSON-1052419078-project] 10.222.0.33 "GET /compute/v2.1/servers/df938010-ebc5-429f-8499-4b55eff7cab9" status: 200 len: 1315 microversion: 2.1 time: 1.167926 Jul 18 10:29:34.595577 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 44/93] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:29:33 2022] GET /compute/v2.1/servers/df938010-ebc5-429f-8499-4b55eff7cab9 => generated 1315 bytes in 1173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:29:34.595577 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-69df2299-0ab8-4a15-83b1-f03a67ca5372 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:29:34.596404 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-69df2299-0ab8-4a15-83b1-f03a67ca5372 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] [instance: 78bb7f95-9846-4a59-9f77-a3fe69005eec] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:29:34.614800 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-69df2299-0ab8-4a15-83b1-f03a67ca5372 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:29:34.615254 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-69df2299-0ab8-4a15-83b1-f03a67ca5372 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:29:34.616030 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-69df2299-0ab8-4a15-83b1-f03a67ca5372 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:29:34.620843 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-69df2299-0ab8-4a15-83b1-f03a67ca5372 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:29:34.913989 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-69df2299-0ab8-4a15-83b1-f03a67ca5372 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a431c9708f4694bc0d514133e76088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a1921237622439bab89676e11477c13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:29:34.916249 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-a401437e-6deb-4ed9-88f7-fb08e47c2560 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '986f90dfbad14324b3fffbd790d60a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e487deb7ff45bdbf2cc002d42d12a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:29:34.928468 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-a401437e-6deb-4ed9-88f7-fb08e47c2560 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] 10.222.0.33 "GET /compute/v2.1/servers/dcb1b50b-9e62-4ff3-9875-3d4635597b45" status: 200 len: 1361 microversion: 2.1 time: 0.403860 Jul 18 10:29:34.931292 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-69df2299-0ab8-4a15-83b1-f03a67ca5372 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] 10.222.0.33 "GET /compute/v2.1/servers/78bb7f95-9846-4a59-9f77-a3fe69005eec" status: 200 len: 1321 microversion: 2.1 time: 0.342753 Jul 18 10:29:34.941460 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 45/94] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:29:34 2022] GET /compute/v2.1/servers/78bb7f95-9846-4a59-9f77-a3fe69005eec => generated 1321 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:29:34.942160 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 50/95] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:29:34 2022] GET /compute/v2.1/servers/dcb1b50b-9e62-4ff3-9875-3d4635597b45 => generated 1361 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:29:35.540039 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-b5ccfe06-7433-4546-8fe9-b6cb904399c7 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:29:35.541939 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-b5ccfe06-7433-4546-8fe9-b6cb904399c7 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] [instance: db62c05e-28a8-4121-a6e5-8abb802f7a17] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:29:35.545074 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG dbcounter [-] [117879] Writing DB stats nova_cell0:SELECT=2 {{(pid=117879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:29:35.557576 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-b5ccfe06-7433-4546-8fe9-b6cb904399c7 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:29:35.562013 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-b5ccfe06-7433-4546-8fe9-b6cb904399c7 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:29:35.563409 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-b5ccfe06-7433-4546-8fe9-b6cb904399c7 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:29:35.565268 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-b5ccfe06-7433-4546-8fe9-b6cb904399c7 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:29:35.756376 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [req-ea2b773b-7c92-48df-8584-e665089958d0 req-eddb524b-214b-4eac-ae0f-cfeb89a00b8b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "78bb7f95-9846-4a59-9f77-a3fe69005eec", "name": "network-vif-plugged", "status": "completed", "tag": "13cc5a6d-eabb-457d-adf0-12b5abac3083"}]} {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:29:35.773565 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [req-ea2b773b-7c92-48df-8584-e665089958d0 req-eddb524b-214b-4eac-ae0f-cfeb89a00b8b service nova] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:29:35.775581 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [req-ea2b773b-7c92-48df-8584-e665089958d0 req-eddb524b-214b-4eac-ae0f-cfeb89a00b8b service nova] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:29:35.806579 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.compute.server_external_events [req-ea2b773b-7c92-48df-8584-e665089958d0 req-eddb524b-214b-4eac-ae0f-cfeb89a00b8b service nova] Creating event network-vif-plugged:13cc5a6d-eabb-457d-adf0-12b5abac3083 for instance 78bb7f95-9846-4a59-9f77-a3fe69005eec on hv-cinder-83754 Jul 18 10:29:35.813186 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [req-ea2b773b-7c92-48df-8584-e665089958d0 req-eddb524b-214b-4eac-ae0f-cfeb89a00b8b service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.346976 Jul 18 10:29:35.814666 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 46/96] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jul 18 10:29:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:29:35.857935 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-1baa997f-4628-435c-9679-506105c004d8 tempest-DeleteServersTestJSON-1052419078 tempest-DeleteServersTestJSON-1052419078-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:29:35.859747 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-1baa997f-4628-435c-9679-506105c004d8 tempest-DeleteServersTestJSON-1052419078 tempest-DeleteServersTestJSON-1052419078-project] [instance: df938010-ebc5-429f-8499-4b55eff7cab9] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:29:35.897189 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-1baa997f-4628-435c-9679-506105c004d8 tempest-DeleteServersTestJSON-1052419078 tempest-DeleteServersTestJSON-1052419078-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:29:35.897648 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-1baa997f-4628-435c-9679-506105c004d8 tempest-DeleteServersTestJSON-1052419078 tempest-DeleteServersTestJSON-1052419078-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:29:35.904819 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-1baa997f-4628-435c-9679-506105c004d8 tempest-DeleteServersTestJSON-1052419078 tempest-DeleteServersTestJSON-1052419078-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:29:35.906577 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-1baa997f-4628-435c-9679-506105c004d8 tempest-DeleteServersTestJSON-1052419078 tempest-DeleteServersTestJSON-1052419078-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:29:36.036731 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-b5ccfe06-7433-4546-8fe9-b6cb904399c7 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f25c72896a2d4d619e5ad4b5a0a79aa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cf3d5bfe9a745f38372c42c9cfa1f63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:29:36.058342 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-b5ccfe06-7433-4546-8fe9-b6cb904399c7 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] 10.222.0.33 "GET /compute/v2.1/servers/db62c05e-28a8-4121-a6e5-8abb802f7a17" status: 200 len: 1366 microversion: 2.1 time: 0.522937 Jul 18 10:29:36.059093 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 51/97] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:29:35 2022] GET /compute/v2.1/servers/db62c05e-28a8-4121-a6e5-8abb802f7a17 => generated 1366 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:29:36.068308 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-f5d1f01f-8476-4e48-8496-fbe1e6f8a709 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:29:36.068308 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-f5d1f01f-8476-4e48-8496-fbe1e6f8a709 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] [instance: 78bb7f95-9846-4a59-9f77-a3fe69005eec] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:29:36.071586 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-f5d1f01f-8476-4e48-8496-fbe1e6f8a709 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:29:36.072102 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-f5d1f01f-8476-4e48-8496-fbe1e6f8a709 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:29:36.073185 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-f5d1f01f-8476-4e48-8496-fbe1e6f8a709 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:29:36.073560 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-f5d1f01f-8476-4e48-8496-fbe1e6f8a709 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:29:36.499566 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-1baa997f-4628-435c-9679-506105c004d8 tempest-DeleteServersTestJSON-1052419078 tempest-DeleteServersTestJSON-1052419078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0f993e44c624f65abae22540ce7dffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daab623e57e54081b262d4a8fe124f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:29:36.521382 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-1baa997f-4628-435c-9679-506105c004d8 tempest-DeleteServersTestJSON-1052419078 tempest-DeleteServersTestJSON-1052419078-project] 10.222.0.33 "GET /compute/v2.1/servers/df938010-ebc5-429f-8499-4b55eff7cab9" status: 200 len: 1315 microversion: 2.1 time: 0.705120 Jul 18 10:29:36.521958 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 47/98] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:29:35 2022] GET /compute/v2.1/servers/df938010-ebc5-429f-8499-4b55eff7cab9 => generated 1315 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:29:36.536203 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-cfa89d18-1475-4281-a64c-2c0ed79b68b1 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:29:36.540961 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-cfa89d18-1475-4281-a64c-2c0ed79b68b1 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] [instance: dcb1b50b-9e62-4ff3-9875-3d4635597b45] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:29:36.546870 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-cfa89d18-1475-4281-a64c-2c0ed79b68b1 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:29:36.547521 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-cfa89d18-1475-4281-a64c-2c0ed79b68b1 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:29:36.548667 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-cfa89d18-1475-4281-a64c-2c0ed79b68b1 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:29:36.549428 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-cfa89d18-1475-4281-a64c-2c0ed79b68b1 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:29:36.574926 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-f5d1f01f-8476-4e48-8496-fbe1e6f8a709 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a431c9708f4694bc0d514133e76088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a1921237622439bab89676e11477c13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:29:36.583879 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-f5d1f01f-8476-4e48-8496-fbe1e6f8a709 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] 10.222.0.33 "GET /compute/v2.1/servers/78bb7f95-9846-4a59-9f77-a3fe69005eec" status: 200 len: 1321 microversion: 2.1 time: 0.523670 Jul 18 10:29:36.584641 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 52/99] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:29:36 2022] GET /compute/v2.1/servers/78bb7f95-9846-4a59-9f77-a3fe69005eec => generated 1321 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:29:37.079055 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-d5c1fa1c-ee85-4702-860e-851c160cef07 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:29:37.079664 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-d5c1fa1c-ee85-4702-860e-851c160cef07 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] [instance: db62c05e-28a8-4121-a6e5-8abb802f7a17] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:29:37.099245 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-d5c1fa1c-ee85-4702-860e-851c160cef07 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:29:37.099701 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-d5c1fa1c-ee85-4702-860e-851c160cef07 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:29:37.100483 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-d5c1fa1c-ee85-4702-860e-851c160cef07 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:29:37.100961 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-d5c1fa1c-ee85-4702-860e-851c160cef07 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:29:37.538454 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-cfa89d18-1475-4281-a64c-2c0ed79b68b1 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '986f90dfbad14324b3fffbd790d60a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e487deb7ff45bdbf2cc002d42d12a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:29:37.557144 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-cfa89d18-1475-4281-a64c-2c0ed79b68b1 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] 10.222.0.33 "GET /compute/v2.1/servers/dcb1b50b-9e62-4ff3-9875-3d4635597b45" status: 200 len: 1361 microversion: 2.1 time: 1.034113 Jul 18 10:29:37.559755 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 48/100] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:29:36 2022] GET /compute/v2.1/servers/dcb1b50b-9e62-4ff3-9875-3d4635597b45 => generated 1361 bytes in 1037 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:29:37.576518 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-78ee4965-416d-4c84-b74e-741e155e8863 tempest-DeleteServersTestJSON-1052419078 tempest-DeleteServersTestJSON-1052419078-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:29:37.577478 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-78ee4965-416d-4c84-b74e-741e155e8863 tempest-DeleteServersTestJSON-1052419078 tempest-DeleteServersTestJSON-1052419078-project] [instance: df938010-ebc5-429f-8499-4b55eff7cab9] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:29:37.587347 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-78ee4965-416d-4c84-b74e-741e155e8863 tempest-DeleteServersTestJSON-1052419078 tempest-DeleteServersTestJSON-1052419078-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:29:37.588139 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-78ee4965-416d-4c84-b74e-741e155e8863 tempest-DeleteServersTestJSON-1052419078 tempest-DeleteServersTestJSON-1052419078-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:29:37.589224 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-78ee4965-416d-4c84-b74e-741e155e8863 tempest-DeleteServersTestJSON-1052419078 tempest-DeleteServersTestJSON-1052419078-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:29:37.589796 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-78ee4965-416d-4c84-b74e-741e155e8863 tempest-DeleteServersTestJSON-1052419078 tempest-DeleteServersTestJSON-1052419078-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:29:37.765362 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG dbcounter [-] [117880] Writing DB stats nova_cell0:SELECT=2 {{(pid=117880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:29:37.910881 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-d5c1fa1c-ee85-4702-860e-851c160cef07 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f25c72896a2d4d619e5ad4b5a0a79aa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cf3d5bfe9a745f38372c42c9cfa1f63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:29:37.924100 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-d5c1fa1c-ee85-4702-860e-851c160cef07 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] 10.222.0.33 "GET /compute/v2.1/servers/db62c05e-28a8-4121-a6e5-8abb802f7a17" status: 200 len: 1366 microversion: 2.1 time: 0.846843 Jul 18 10:29:37.934666 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 53/101] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:29:37 2022] GET /compute/v2.1/servers/db62c05e-28a8-4121-a6e5-8abb802f7a17 => generated 1366 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:29:37.934666 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-87d23f66-3aa9-4d6e-805f-66b2c4b055aa tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:29:37.934666 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-87d23f66-3aa9-4d6e-805f-66b2c4b055aa tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] [instance: 78bb7f95-9846-4a59-9f77-a3fe69005eec] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:29:37.953462 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-87d23f66-3aa9-4d6e-805f-66b2c4b055aa tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:29:37.954751 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-87d23f66-3aa9-4d6e-805f-66b2c4b055aa tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:29:37.955627 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-87d23f66-3aa9-4d6e-805f-66b2c4b055aa tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:29:37.956067 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-87d23f66-3aa9-4d6e-805f-66b2c4b055aa tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:29:37.993589 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-78ee4965-416d-4c84-b74e-741e155e8863 tempest-DeleteServersTestJSON-1052419078 tempest-DeleteServersTestJSON-1052419078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0f993e44c624f65abae22540ce7dffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daab623e57e54081b262d4a8fe124f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:29:38.003792 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-78ee4965-416d-4c84-b74e-741e155e8863 tempest-DeleteServersTestJSON-1052419078 tempest-DeleteServersTestJSON-1052419078-project] 10.222.0.33 "GET /compute/v2.1/servers/df938010-ebc5-429f-8499-4b55eff7cab9" status: 200 len: 1315 microversion: 2.1 time: 0.431453 Jul 18 10:29:38.006036 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 49/102] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:29:37 2022] GET /compute/v2.1/servers/df938010-ebc5-429f-8499-4b55eff7cab9 => generated 1315 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:29:38.010922 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [req-8bb387d0-7bcd-4745-949f-f37b0e958b6f req-44d9c13d-dab0-4e5a-8ec2-deac95a77889 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "591fab72-3729-4b6f-af75-cc55766b7eae", "name": "network-vif-plugged", "status": "completed", "tag": "3380728a-d068-450d-b0c7-feb491a61db5"}]} {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:29:38.021072 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [req-8bb387d0-7bcd-4745-949f-f37b0e958b6f req-44d9c13d-dab0-4e5a-8ec2-deac95a77889 service nova] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:29:38.021704 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [req-8bb387d0-7bcd-4745-949f-f37b0e958b6f req-44d9c13d-dab0-4e5a-8ec2-deac95a77889 service nova] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:29:38.035658 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.compute.server_external_events [req-8bb387d0-7bcd-4745-949f-f37b0e958b6f req-44d9c13d-dab0-4e5a-8ec2-deac95a77889 service nova] Creating event network-vif-plugged:3380728a-d068-450d-b0c7-feb491a61db5 for instance 591fab72-3729-4b6f-af75-cc55766b7eae on hv-cinder-83754 Jul 18 10:29:38.041418 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [req-8bb387d0-7bcd-4745-949f-f37b0e958b6f req-44d9c13d-dab0-4e5a-8ec2-deac95a77889 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033797 Jul 18 10:29:38.042174 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 50/103] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jul 18 10:29:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:29:38.164820 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-87d23f66-3aa9-4d6e-805f-66b2c4b055aa tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a431c9708f4694bc0d514133e76088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a1921237622439bab89676e11477c13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:29:38.183829 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-87d23f66-3aa9-4d6e-805f-66b2c4b055aa tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] 10.222.0.33 "GET /compute/v2.1/servers/78bb7f95-9846-4a59-9f77-a3fe69005eec" status: 200 len: 1321 microversion: 2.1 time: 0.255793 Jul 18 10:29:38.184945 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 54/104] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:29:37 2022] GET /compute/v2.1/servers/78bb7f95-9846-4a59-9f77-a3fe69005eec => generated 1321 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:29:38.576403 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-5764d113-43ff-48ae-8a91-f5e43fec2255 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:29:38.577131 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-5764d113-43ff-48ae-8a91-f5e43fec2255 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] [instance: dcb1b50b-9e62-4ff3-9875-3d4635597b45] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:29:38.588688 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-5764d113-43ff-48ae-8a91-f5e43fec2255 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:29:38.589141 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-5764d113-43ff-48ae-8a91-f5e43fec2255 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:29:38.590060 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-5764d113-43ff-48ae-8a91-f5e43fec2255 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:29:38.590513 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-5764d113-43ff-48ae-8a91-f5e43fec2255 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:29:38.750399 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-5764d113-43ff-48ae-8a91-f5e43fec2255 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '986f90dfbad14324b3fffbd790d60a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e487deb7ff45bdbf2cc002d42d12a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:29:38.766365 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-5764d113-43ff-48ae-8a91-f5e43fec2255 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] 10.222.0.33 "GET /compute/v2.1/servers/dcb1b50b-9e62-4ff3-9875-3d4635597b45" status: 200 len: 1361 microversion: 2.1 time: 0.193954 Jul 18 10:29:38.777584 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 51/105] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:29:38 2022] GET /compute/v2.1/servers/dcb1b50b-9e62-4ff3-9875-3d4635597b45 => generated 1361 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:29:38.942559 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-3af8dd8e-c8f9-4335-9fd7-6422ec35efb1 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:29:38.943161 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-3af8dd8e-c8f9-4335-9fd7-6422ec35efb1 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] [instance: db62c05e-28a8-4121-a6e5-8abb802f7a17] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:29:38.952318 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-3af8dd8e-c8f9-4335-9fd7-6422ec35efb1 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:29:38.953061 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-3af8dd8e-c8f9-4335-9fd7-6422ec35efb1 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:29:38.953842 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-3af8dd8e-c8f9-4335-9fd7-6422ec35efb1 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:29:38.955650 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-3af8dd8e-c8f9-4335-9fd7-6422ec35efb1 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:29:39.022358 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-6373203f-7dcb-4ec0-8a0a-1e9528d93703 tempest-DeleteServersTestJSON-1052419078 tempest-DeleteServersTestJSON-1052419078-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:29:39.023730 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-6373203f-7dcb-4ec0-8a0a-1e9528d93703 tempest-DeleteServersTestJSON-1052419078 tempest-DeleteServersTestJSON-1052419078-project] [instance: df938010-ebc5-429f-8499-4b55eff7cab9] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:29:39.031963 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-6373203f-7dcb-4ec0-8a0a-1e9528d93703 tempest-DeleteServersTestJSON-1052419078 tempest-DeleteServersTestJSON-1052419078-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:29:39.032895 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-6373203f-7dcb-4ec0-8a0a-1e9528d93703 tempest-DeleteServersTestJSON-1052419078 tempest-DeleteServersTestJSON-1052419078-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:29:39.036256 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-6373203f-7dcb-4ec0-8a0a-1e9528d93703 tempest-DeleteServersTestJSON-1052419078 tempest-DeleteServersTestJSON-1052419078-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:29:39.036729 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-6373203f-7dcb-4ec0-8a0a-1e9528d93703 tempest-DeleteServersTestJSON-1052419078 tempest-DeleteServersTestJSON-1052419078-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:29:39.227886 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-3af8dd8e-c8f9-4335-9fd7-6422ec35efb1 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f25c72896a2d4d619e5ad4b5a0a79aa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cf3d5bfe9a745f38372c42c9cfa1f63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:29:39.240629 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-3af8dd8e-c8f9-4335-9fd7-6422ec35efb1 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] 10.222.0.33 "GET /compute/v2.1/servers/db62c05e-28a8-4121-a6e5-8abb802f7a17" status: 200 len: 1366 microversion: 2.1 time: 0.302432 Jul 18 10:29:39.246732 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 55/106] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:29:38 2022] GET /compute/v2.1/servers/db62c05e-28a8-4121-a6e5-8abb802f7a17 => generated 1366 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:29:39.263599 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-fa5e6321-dd58-4736-a96d-30181c34ac09 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:29:39.266242 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-fa5e6321-dd58-4736-a96d-30181c34ac09 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] [instance: 78bb7f95-9846-4a59-9f77-a3fe69005eec] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:29:39.279510 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-fa5e6321-dd58-4736-a96d-30181c34ac09 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:29:39.280405 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-fa5e6321-dd58-4736-a96d-30181c34ac09 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:29:39.281462 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-fa5e6321-dd58-4736-a96d-30181c34ac09 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:29:39.282112 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-fa5e6321-dd58-4736-a96d-30181c34ac09 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:29:39.303155 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-6373203f-7dcb-4ec0-8a0a-1e9528d93703 tempest-DeleteServersTestJSON-1052419078 tempest-DeleteServersTestJSON-1052419078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0f993e44c624f65abae22540ce7dffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daab623e57e54081b262d4a8fe124f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:29:39.314964 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-6373203f-7dcb-4ec0-8a0a-1e9528d93703 tempest-DeleteServersTestJSON-1052419078 tempest-DeleteServersTestJSON-1052419078-project] 10.222.0.33 "GET /compute/v2.1/servers/df938010-ebc5-429f-8499-4b55eff7cab9" status: 200 len: 1315 microversion: 2.1 time: 0.297308 Jul 18 10:29:39.316849 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 52/107] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:29:39 2022] GET /compute/v2.1/servers/df938010-ebc5-429f-8499-4b55eff7cab9 => generated 1315 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:29:39.544267 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-fa5e6321-dd58-4736-a96d-30181c34ac09 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a431c9708f4694bc0d514133e76088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a1921237622439bab89676e11477c13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:29:39.555240 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-fa5e6321-dd58-4736-a96d-30181c34ac09 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] 10.222.0.33 "GET /compute/v2.1/servers/78bb7f95-9846-4a59-9f77-a3fe69005eec" status: 200 len: 1321 microversion: 2.1 time: 0.297752 Jul 18 10:29:39.557102 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 56/108] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:29:39 2022] GET /compute/v2.1/servers/78bb7f95-9846-4a59-9f77-a3fe69005eec => generated 1321 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:29:39.784178 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-0f0ca9f6-e50c-425d-b147-e2a58056c706 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:29:39.785576 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-0f0ca9f6-e50c-425d-b147-e2a58056c706 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] [instance: dcb1b50b-9e62-4ff3-9875-3d4635597b45] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:29:39.791817 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-0f0ca9f6-e50c-425d-b147-e2a58056c706 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:29:39.792224 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-0f0ca9f6-e50c-425d-b147-e2a58056c706 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:29:39.793026 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-0f0ca9f6-e50c-425d-b147-e2a58056c706 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:29:39.793627 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-0f0ca9f6-e50c-425d-b147-e2a58056c706 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:29:39.973296 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-0f0ca9f6-e50c-425d-b147-e2a58056c706 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '986f90dfbad14324b3fffbd790d60a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e487deb7ff45bdbf2cc002d42d12a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:29:39.982338 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-0f0ca9f6-e50c-425d-b147-e2a58056c706 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] 10.222.0.33 "GET /compute/v2.1/servers/dcb1b50b-9e62-4ff3-9875-3d4635597b45" status: 200 len: 1361 microversion: 2.1 time: 0.202671 Jul 18 10:29:39.983483 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 53/109] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:29:39 2022] GET /compute/v2.1/servers/dcb1b50b-9e62-4ff3-9875-3d4635597b45 => generated 1361 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:29:40.057571 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [req-00797f1b-b584-436c-881b-c2d807580b40 req-357d73f4-347f-4ea6-8fdb-80be3b98933a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db62c05e-28a8-4121-a6e5-8abb802f7a17", "name": "network-vif-plugged", "status": "completed", "tag": "f97d9284-09c3-4aa3-8f54-5bb526b9fe08"}, {"server_uuid": "df938010-ebc5-429f-8499-4b55eff7cab9", "name": "network-vif-plugged", "status": "completed", "tag": "b4d3e21d-6206-4ae8-99b7-004371bb68f2"}]} {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:29:40.067130 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [req-00797f1b-b584-436c-881b-c2d807580b40 req-357d73f4-347f-4ea6-8fdb-80be3b98933a service nova] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:29:40.067762 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [req-00797f1b-b584-436c-881b-c2d807580b40 req-357d73f4-347f-4ea6-8fdb-80be3b98933a service nova] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:29:40.081252 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.compute.server_external_events [req-00797f1b-b584-436c-881b-c2d807580b40 req-357d73f4-347f-4ea6-8fdb-80be3b98933a service nova] Creating event network-vif-plugged:f97d9284-09c3-4aa3-8f54-5bb526b9fe08 for instance db62c05e-28a8-4121-a6e5-8abb802f7a17 on hv-cinder-83754 Jul 18 10:29:40.082352 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.compute.server_external_events [req-00797f1b-b584-436c-881b-c2d807580b40 req-357d73f4-347f-4ea6-8fdb-80be3b98933a service nova] Creating event network-vif-plugged:b4d3e21d-6206-4ae8-99b7-004371bb68f2 for instance df938010-ebc5-429f-8499-4b55eff7cab9 on hv-cinder-83754 Jul 18 10:29:40.089382 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [req-00797f1b-b584-436c-881b-c2d807580b40 req-357d73f4-347f-4ea6-8fdb-80be3b98933a service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.035977 Jul 18 10:29:40.090130 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 57/110] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jul 18 10:29:40 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:29:40.261216 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-23b9423e-c8f7-4e35-acfc-4ce523bd8e1f tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:29:40.261997 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-23b9423e-c8f7-4e35-acfc-4ce523bd8e1f tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] [instance: db62c05e-28a8-4121-a6e5-8abb802f7a17] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:29:40.273153 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-23b9423e-c8f7-4e35-acfc-4ce523bd8e1f tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:29:40.273990 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-23b9423e-c8f7-4e35-acfc-4ce523bd8e1f tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:29:40.274752 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-23b9423e-c8f7-4e35-acfc-4ce523bd8e1f tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:29:40.275183 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-23b9423e-c8f7-4e35-acfc-4ce523bd8e1f tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:29:40.334272 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-a0c94890-01e8-44c9-a089-e55cd68125a9 tempest-DeleteServersTestJSON-1052419078 tempest-DeleteServersTestJSON-1052419078-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:29:40.335320 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-a0c94890-01e8-44c9-a089-e55cd68125a9 tempest-DeleteServersTestJSON-1052419078 tempest-DeleteServersTestJSON-1052419078-project] [instance: df938010-ebc5-429f-8499-4b55eff7cab9] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:29:40.352802 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-a0c94890-01e8-44c9-a089-e55cd68125a9 tempest-DeleteServersTestJSON-1052419078 tempest-DeleteServersTestJSON-1052419078-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:29:40.353528 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-a0c94890-01e8-44c9-a089-e55cd68125a9 tempest-DeleteServersTestJSON-1052419078 tempest-DeleteServersTestJSON-1052419078-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:29:40.354738 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-a0c94890-01e8-44c9-a089-e55cd68125a9 tempest-DeleteServersTestJSON-1052419078 tempest-DeleteServersTestJSON-1052419078-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:29:40.355328 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-a0c94890-01e8-44c9-a089-e55cd68125a9 tempest-DeleteServersTestJSON-1052419078 tempest-DeleteServersTestJSON-1052419078-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:29:40.593819 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-23b9423e-c8f7-4e35-acfc-4ce523bd8e1f tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f25c72896a2d4d619e5ad4b5a0a79aa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cf3d5bfe9a745f38372c42c9cfa1f63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:29:40.604437 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-23b9423e-c8f7-4e35-acfc-4ce523bd8e1f tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] 10.222.0.33 "GET /compute/v2.1/servers/db62c05e-28a8-4121-a6e5-8abb802f7a17" status: 200 len: 1366 microversion: 2.1 time: 0.344766 Jul 18 10:29:40.605687 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 54/111] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:29:40 2022] GET /compute/v2.1/servers/db62c05e-28a8-4121-a6e5-8abb802f7a17 => generated 1366 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:29:40.612400 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-ec52ca23-a38d-430f-ba89-e16f872a05cf tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:29:40.614505 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-ec52ca23-a38d-430f-ba89-e16f872a05cf tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] [instance: 78bb7f95-9846-4a59-9f77-a3fe69005eec] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:29:40.623594 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-ec52ca23-a38d-430f-ba89-e16f872a05cf tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:29:40.624251 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-ec52ca23-a38d-430f-ba89-e16f872a05cf tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:29:40.625247 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-ec52ca23-a38d-430f-ba89-e16f872a05cf tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:29:40.625905 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-ec52ca23-a38d-430f-ba89-e16f872a05cf tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:29:40.635617 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-a0c94890-01e8-44c9-a089-e55cd68125a9 tempest-DeleteServersTestJSON-1052419078 tempest-DeleteServersTestJSON-1052419078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0f993e44c624f65abae22540ce7dffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daab623e57e54081b262d4a8fe124f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:29:40.646808 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-a0c94890-01e8-44c9-a089-e55cd68125a9 tempest-DeleteServersTestJSON-1052419078 tempest-DeleteServersTestJSON-1052419078-project] 10.222.0.33 "GET /compute/v2.1/servers/df938010-ebc5-429f-8499-4b55eff7cab9" status: 200 len: 1315 microversion: 2.1 time: 0.317424 Jul 18 10:29:40.664133 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 58/112] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:29:40 2022] GET /compute/v2.1/servers/df938010-ebc5-429f-8499-4b55eff7cab9 => generated 1315 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:29:40.794500 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-ec52ca23-a38d-430f-ba89-e16f872a05cf tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a431c9708f4694bc0d514133e76088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a1921237622439bab89676e11477c13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:29:40.802034 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-ec52ca23-a38d-430f-ba89-e16f872a05cf tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] 10.222.0.33 "GET /compute/v2.1/servers/78bb7f95-9846-4a59-9f77-a3fe69005eec" status: 200 len: 1514 microversion: 2.1 time: 0.194869 Jul 18 10:29:40.802640 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 55/113] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:29:40 2022] GET /compute/v2.1/servers/78bb7f95-9846-4a59-9f77-a3fe69005eec => generated 1514 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:29:40.821264 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-90f94b11-9a39-4c72-a375-5a07a138c399 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:29:40.822550 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-90f94b11-9a39-4c72-a375-5a07a138c399 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] [instance: 78bb7f95-9846-4a59-9f77-a3fe69005eec] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:29:40.835549 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-90f94b11-9a39-4c72-a375-5a07a138c399 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:29:40.836381 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-90f94b11-9a39-4c72-a375-5a07a138c399 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:29:40.837972 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-90f94b11-9a39-4c72-a375-5a07a138c399 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:29:40.841224 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-90f94b11-9a39-4c72-a375-5a07a138c399 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:29:40.926942 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG dbcounter [-] [117879] Writing DB stats nova_cell1:SELECT=100 {{(pid=117879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:29:40.944965 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.objects.instance [None req-90f94b11-9a39-4c72-a375-5a07a138c399 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lazy-loading 'flavor' on Instance uuid 78bb7f95-9846-4a59-9f77-a3fe69005eec {{(pid=117879) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 10:29:41.000650 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-7b3a83c0-9b97-4f50-b935-bac36e52deaa tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:29:41.001312 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-7b3a83c0-9b97-4f50-b935-bac36e52deaa tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] [instance: dcb1b50b-9e62-4ff3-9875-3d4635597b45] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:29:41.018120 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-7b3a83c0-9b97-4f50-b935-bac36e52deaa tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:29:41.021381 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-7b3a83c0-9b97-4f50-b935-bac36e52deaa tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:29:41.024258 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-7b3a83c0-9b97-4f50-b935-bac36e52deaa tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:29:41.024866 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-7b3a83c0-9b97-4f50-b935-bac36e52deaa tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:29:41.107362 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-90f94b11-9a39-4c72-a375-5a07a138c399 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] 10.222.0.33 "POST /compute/v2.1/servers/78bb7f95-9846-4a59-9f77-a3fe69005eec/action" status: 200 len: 32 microversion: 2.1 time: 0.290945 Jul 18 10:29:41.114254 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 59/114] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Jul 18 10:29:40 2022] POST /compute/v2.1/servers/78bb7f95-9846-4a59-9f77-a3fe69005eec/action => generated 32 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 10:29:41.120847 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-5117931d-1573-4e3a-b4d3-bc49c9a1aa51 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:29:41.121905 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-5117931d-1573-4e3a-b4d3-bc49c9a1aa51 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] [instance: 78bb7f95-9846-4a59-9f77-a3fe69005eec] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:29:41.130234 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-5117931d-1573-4e3a-b4d3-bc49c9a1aa51 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:29:41.130947 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-5117931d-1573-4e3a-b4d3-bc49c9a1aa51 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:29:41.132010 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-5117931d-1573-4e3a-b4d3-bc49c9a1aa51 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:29:41.132714 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-5117931d-1573-4e3a-b4d3-bc49c9a1aa51 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:29:41.287352 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-7b3a83c0-9b97-4f50-b935-bac36e52deaa tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '986f90dfbad14324b3fffbd790d60a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e487deb7ff45bdbf2cc002d42d12a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:29:41.291744 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG dbcounter [-] [117880] Writing DB stats nova_cell1:SELECT=100 {{(pid=117880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:29:41.303609 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-7b3a83c0-9b97-4f50-b935-bac36e52deaa tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] 10.222.0.33 "GET /compute/v2.1/servers/dcb1b50b-9e62-4ff3-9875-3d4635597b45" status: 200 len: 1361 microversion: 2.1 time: 0.305051 Jul 18 10:29:41.305049 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 56/115] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:29:40 2022] GET /compute/v2.1/servers/dcb1b50b-9e62-4ff3-9875-3d4635597b45 => generated 1361 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:29:41.364714 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-5117931d-1573-4e3a-b4d3-bc49c9a1aa51 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a431c9708f4694bc0d514133e76088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a1921237622439bab89676e11477c13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:29:41.373738 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-5117931d-1573-4e3a-b4d3-bc49c9a1aa51 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] 10.222.0.33 "GET /compute/v2.1/servers/78bb7f95-9846-4a59-9f77-a3fe69005eec" status: 200 len: 1520 microversion: 2.1 time: 0.257267 Jul 18 10:29:41.374646 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 60/116] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:29:41 2022] GET /compute/v2.1/servers/78bb7f95-9846-4a59-9f77-a3fe69005eec => generated 1520 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:29:41.621644 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-fbfd134b-4517-414f-8c7c-6d73621826c5 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:29:41.622258 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-fbfd134b-4517-414f-8c7c-6d73621826c5 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] [instance: db62c05e-28a8-4121-a6e5-8abb802f7a17] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:29:41.632892 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-fbfd134b-4517-414f-8c7c-6d73621826c5 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:29:41.633430 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-fbfd134b-4517-414f-8c7c-6d73621826c5 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:29:41.634788 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-fbfd134b-4517-414f-8c7c-6d73621826c5 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:29:41.639206 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-fbfd134b-4517-414f-8c7c-6d73621826c5 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:29:41.665586 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-c7e58cde-e08a-45a4-a11f-6992ca61887f tempest-DeleteServersTestJSON-1052419078 tempest-DeleteServersTestJSON-1052419078-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:29:41.666189 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-c7e58cde-e08a-45a4-a11f-6992ca61887f tempest-DeleteServersTestJSON-1052419078 tempest-DeleteServersTestJSON-1052419078-project] [instance: df938010-ebc5-429f-8499-4b55eff7cab9] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:29:41.674111 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-c7e58cde-e08a-45a4-a11f-6992ca61887f tempest-DeleteServersTestJSON-1052419078 tempest-DeleteServersTestJSON-1052419078-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:29:41.681496 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-c7e58cde-e08a-45a4-a11f-6992ca61887f tempest-DeleteServersTestJSON-1052419078 tempest-DeleteServersTestJSON-1052419078-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:29:41.682703 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-c7e58cde-e08a-45a4-a11f-6992ca61887f tempest-DeleteServersTestJSON-1052419078 tempest-DeleteServersTestJSON-1052419078-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:29:41.683302 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-c7e58cde-e08a-45a4-a11f-6992ca61887f tempest-DeleteServersTestJSON-1052419078 tempest-DeleteServersTestJSON-1052419078-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:29:41.955711 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-fbfd134b-4517-414f-8c7c-6d73621826c5 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f25c72896a2d4d619e5ad4b5a0a79aa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cf3d5bfe9a745f38372c42c9cfa1f63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:29:41.964574 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-fbfd134b-4517-414f-8c7c-6d73621826c5 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] 10.222.0.33 "GET /compute/v2.1/servers/db62c05e-28a8-4121-a6e5-8abb802f7a17" status: 200 len: 1366 microversion: 2.1 time: 0.347131 Jul 18 10:29:41.965143 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 57/117] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:29:41 2022] GET /compute/v2.1/servers/db62c05e-28a8-4121-a6e5-8abb802f7a17 => generated 1366 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:29:41.968564 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-c7e58cde-e08a-45a4-a11f-6992ca61887f tempest-DeleteServersTestJSON-1052419078 tempest-DeleteServersTestJSON-1052419078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0f993e44c624f65abae22540ce7dffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daab623e57e54081b262d4a8fe124f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:29:41.977649 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-c7e58cde-e08a-45a4-a11f-6992ca61887f tempest-DeleteServersTestJSON-1052419078 tempest-DeleteServersTestJSON-1052419078-project] 10.222.0.33 "GET /compute/v2.1/servers/df938010-ebc5-429f-8499-4b55eff7cab9" status: 200 len: 1315 microversion: 2.1 time: 0.315864 Jul 18 10:29:41.980322 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 61/118] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:29:41 2022] GET /compute/v2.1/servers/df938010-ebc5-429f-8499-4b55eff7cab9 => generated 1315 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:29:42.323666 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-77bdc92c-da24-4374-89f3-e5963abe62de tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:29:42.325730 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-77bdc92c-da24-4374-89f3-e5963abe62de tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] [instance: dcb1b50b-9e62-4ff3-9875-3d4635597b45] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:29:42.336127 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-77bdc92c-da24-4374-89f3-e5963abe62de tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:29:42.336971 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-77bdc92c-da24-4374-89f3-e5963abe62de tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:29:42.337950 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-77bdc92c-da24-4374-89f3-e5963abe62de tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:29:42.338686 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-77bdc92c-da24-4374-89f3-e5963abe62de tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:29:42.395228 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-ef5fb0c9-8f0f-4255-9759-f89b12b92a62 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:29:42.396208 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-ef5fb0c9-8f0f-4255-9759-f89b12b92a62 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] [instance: 78bb7f95-9846-4a59-9f77-a3fe69005eec] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:29:42.403757 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-ef5fb0c9-8f0f-4255-9759-f89b12b92a62 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:29:42.404149 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-ef5fb0c9-8f0f-4255-9759-f89b12b92a62 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:29:42.405053 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-ef5fb0c9-8f0f-4255-9759-f89b12b92a62 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:29:42.405502 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-ef5fb0c9-8f0f-4255-9759-f89b12b92a62 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:29:42.650780 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-77bdc92c-da24-4374-89f3-e5963abe62de tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '986f90dfbad14324b3fffbd790d60a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e487deb7ff45bdbf2cc002d42d12a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:29:42.673245 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-ef5fb0c9-8f0f-4255-9759-f89b12b92a62 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a431c9708f4694bc0d514133e76088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a1921237622439bab89676e11477c13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:29:42.679502 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-77bdc92c-da24-4374-89f3-e5963abe62de tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] 10.222.0.33 "GET /compute/v2.1/servers/dcb1b50b-9e62-4ff3-9875-3d4635597b45" status: 200 len: 1361 microversion: 2.1 time: 0.356106 Jul 18 10:29:42.682444 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 58/119] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:29:42 2022] GET /compute/v2.1/servers/dcb1b50b-9e62-4ff3-9875-3d4635597b45 => generated 1361 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:29:42.691520 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-ef5fb0c9-8f0f-4255-9759-f89b12b92a62 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] 10.222.0.33 "GET /compute/v2.1/servers/78bb7f95-9846-4a59-9f77-a3fe69005eec" status: 200 len: 1520 microversion: 2.1 time: 0.301473 Jul 18 10:29:42.692289 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 62/120] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:29:42 2022] GET /compute/v2.1/servers/78bb7f95-9846-4a59-9f77-a3fe69005eec => generated 1520 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:29:42.984245 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-ce5e4499-7491-4faa-9b36-66dd61434089 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:29:42.985480 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-ce5e4499-7491-4faa-9b36-66dd61434089 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] [instance: db62c05e-28a8-4121-a6e5-8abb802f7a17] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:29:42.997486 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-6a2d0714-59b0-4c97-919d-2e2c16fd2ca3 tempest-DeleteServersTestJSON-1052419078 tempest-DeleteServersTestJSON-1052419078-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:29:42.998255 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-6a2d0714-59b0-4c97-919d-2e2c16fd2ca3 tempest-DeleteServersTestJSON-1052419078 tempest-DeleteServersTestJSON-1052419078-project] [instance: df938010-ebc5-429f-8499-4b55eff7cab9] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:29:43.010670 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-6a2d0714-59b0-4c97-919d-2e2c16fd2ca3 tempest-DeleteServersTestJSON-1052419078 tempest-DeleteServersTestJSON-1052419078-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:29:43.011145 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-6a2d0714-59b0-4c97-919d-2e2c16fd2ca3 tempest-DeleteServersTestJSON-1052419078 tempest-DeleteServersTestJSON-1052419078-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:29:43.011955 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-6a2d0714-59b0-4c97-919d-2e2c16fd2ca3 tempest-DeleteServersTestJSON-1052419078 tempest-DeleteServersTestJSON-1052419078-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:29:43.012923 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-ce5e4499-7491-4faa-9b36-66dd61434089 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:29:43.013375 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-ce5e4499-7491-4faa-9b36-66dd61434089 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:29:43.018904 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-6a2d0714-59b0-4c97-919d-2e2c16fd2ca3 tempest-DeleteServersTestJSON-1052419078 tempest-DeleteServersTestJSON-1052419078-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:29:43.019521 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-ce5e4499-7491-4faa-9b36-66dd61434089 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:29:43.021076 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-ce5e4499-7491-4faa-9b36-66dd61434089 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:29:43.564621 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-6a2d0714-59b0-4c97-919d-2e2c16fd2ca3 tempest-DeleteServersTestJSON-1052419078 tempest-DeleteServersTestJSON-1052419078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0f993e44c624f65abae22540ce7dffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daab623e57e54081b262d4a8fe124f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:29:43.572926 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-ce5e4499-7491-4faa-9b36-66dd61434089 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f25c72896a2d4d619e5ad4b5a0a79aa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cf3d5bfe9a745f38372c42c9cfa1f63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:29:43.573926 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-6a2d0714-59b0-4c97-919d-2e2c16fd2ca3 tempest-DeleteServersTestJSON-1052419078 tempest-DeleteServersTestJSON-1052419078-project] 10.222.0.33 "GET /compute/v2.1/servers/df938010-ebc5-429f-8499-4b55eff7cab9" status: 200 len: 1315 microversion: 2.1 time: 0.580544 Jul 18 10:29:43.575816 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 63/121] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:29:42 2022] GET /compute/v2.1/servers/df938010-ebc5-429f-8499-4b55eff7cab9 => generated 1315 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:29:43.583680 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [req-b90fb0c8-6257-4618-8339-296b172ce8cb req-90dcee3e-6ef9-404f-b37c-de613ff6a940 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dcb1b50b-9e62-4ff3-9875-3d4635597b45", "name": "network-vif-plugged", "status": "completed", "tag": "2be9cb89-71c6-44bf-b559-2446d61bca60"}]} {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:29:43.591517 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-ce5e4499-7491-4faa-9b36-66dd61434089 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] 10.222.0.33 "GET /compute/v2.1/servers/db62c05e-28a8-4121-a6e5-8abb802f7a17" status: 200 len: 1366 microversion: 2.1 time: 0.611706 Jul 18 10:29:43.592366 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 59/122] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:29:42 2022] GET /compute/v2.1/servers/db62c05e-28a8-4121-a6e5-8abb802f7a17 => generated 1366 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:29:43.604733 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [req-b90fb0c8-6257-4618-8339-296b172ce8cb req-90dcee3e-6ef9-404f-b37c-de613ff6a940 service nova] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:29:43.606547 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [req-b90fb0c8-6257-4618-8339-296b172ce8cb req-90dcee3e-6ef9-404f-b37c-de613ff6a940 service nova] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:29:43.633292 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.compute.server_external_events [req-b90fb0c8-6257-4618-8339-296b172ce8cb req-90dcee3e-6ef9-404f-b37c-de613ff6a940 service nova] Creating event network-vif-plugged:2be9cb89-71c6-44bf-b559-2446d61bca60 for instance dcb1b50b-9e62-4ff3-9875-3d4635597b45 on hv-cinder-83754 Jul 18 10:29:43.638604 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [req-b90fb0c8-6257-4618-8339-296b172ce8cb req-90dcee3e-6ef9-404f-b37c-de613ff6a940 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061530 Jul 18 10:29:43.639612 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 64/123] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jul 18 10:29:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:29:43.695981 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-81b1eb06-db74-43cd-b10a-b3a917ae738e tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:29:43.696907 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-81b1eb06-db74-43cd-b10a-b3a917ae738e tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] [instance: dcb1b50b-9e62-4ff3-9875-3d4635597b45] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:29:43.710910 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-cca1b831-23f6-415c-b889-42de7363edb2 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:29:43.718218 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-cca1b831-23f6-415c-b889-42de7363edb2 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] [instance: 78bb7f95-9846-4a59-9f77-a3fe69005eec] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:29:43.731541 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-81b1eb06-db74-43cd-b10a-b3a917ae738e tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:29:43.733164 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-81b1eb06-db74-43cd-b10a-b3a917ae738e tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:29:43.734348 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-81b1eb06-db74-43cd-b10a-b3a917ae738e tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:29:43.734947 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-cca1b831-23f6-415c-b889-42de7363edb2 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:29:43.735577 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-cca1b831-23f6-415c-b889-42de7363edb2 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:29:43.736380 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-81b1eb06-db74-43cd-b10a-b3a917ae738e tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:29:43.736703 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-cca1b831-23f6-415c-b889-42de7363edb2 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:29:43.737291 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-cca1b831-23f6-415c-b889-42de7363edb2 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:29:44.136145 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-cca1b831-23f6-415c-b889-42de7363edb2 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a431c9708f4694bc0d514133e76088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a1921237622439bab89676e11477c13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:29:44.151569 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-cca1b831-23f6-415c-b889-42de7363edb2 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] 10.222.0.33 "GET /compute/v2.1/servers/78bb7f95-9846-4a59-9f77-a3fe69005eec" status: 200 len: 1520 microversion: 2.1 time: 0.445101 Jul 18 10:29:44.152472 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 65/124] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:29:43 2022] GET /compute/v2.1/servers/78bb7f95-9846-4a59-9f77-a3fe69005eec => generated 1520 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:29:44.258736 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-81b1eb06-db74-43cd-b10a-b3a917ae738e tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '986f90dfbad14324b3fffbd790d60a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e487deb7ff45bdbf2cc002d42d12a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:29:44.270618 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-81b1eb06-db74-43cd-b10a-b3a917ae738e tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] 10.222.0.33 "GET /compute/v2.1/servers/dcb1b50b-9e62-4ff3-9875-3d4635597b45" status: 200 len: 1361 microversion: 2.1 time: 0.578741 Jul 18 10:29:44.272798 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 60/125] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:29:43 2022] GET /compute/v2.1/servers/dcb1b50b-9e62-4ff3-9875-3d4635597b45 => generated 1361 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:29:44.591690 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-a51179da-967f-4e73-9b4c-ca224202caf2 tempest-DeleteServersTestJSON-1052419078 tempest-DeleteServersTestJSON-1052419078-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:29:44.592361 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-a51179da-967f-4e73-9b4c-ca224202caf2 tempest-DeleteServersTestJSON-1052419078 tempest-DeleteServersTestJSON-1052419078-project] [instance: df938010-ebc5-429f-8499-4b55eff7cab9] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:29:44.605989 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-a51179da-967f-4e73-9b4c-ca224202caf2 tempest-DeleteServersTestJSON-1052419078 tempest-DeleteServersTestJSON-1052419078-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:29:44.606791 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-a51179da-967f-4e73-9b4c-ca224202caf2 tempest-DeleteServersTestJSON-1052419078 tempest-DeleteServersTestJSON-1052419078-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:29:44.610232 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-a51179da-967f-4e73-9b4c-ca224202caf2 tempest-DeleteServersTestJSON-1052419078 tempest-DeleteServersTestJSON-1052419078-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:29:44.610916 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-a51179da-967f-4e73-9b4c-ca224202caf2 tempest-DeleteServersTestJSON-1052419078 tempest-DeleteServersTestJSON-1052419078-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:29:44.612079 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-4e9eb83a-d7e0-48f8-ae66-55ab1b635ce6 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:29:44.612991 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-4e9eb83a-d7e0-48f8-ae66-55ab1b635ce6 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] [instance: db62c05e-28a8-4121-a6e5-8abb802f7a17] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:29:44.625959 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-4e9eb83a-d7e0-48f8-ae66-55ab1b635ce6 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:29:44.626635 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-4e9eb83a-d7e0-48f8-ae66-55ab1b635ce6 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:29:44.631132 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-4e9eb83a-d7e0-48f8-ae66-55ab1b635ce6 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:29:44.631923 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-4e9eb83a-d7e0-48f8-ae66-55ab1b635ce6 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:29:45.010983 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-4e9eb83a-d7e0-48f8-ae66-55ab1b635ce6 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f25c72896a2d4d619e5ad4b5a0a79aa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cf3d5bfe9a745f38372c42c9cfa1f63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:29:45.023047 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-4e9eb83a-d7e0-48f8-ae66-55ab1b635ce6 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] 10.222.0.33 "GET /compute/v2.1/servers/db62c05e-28a8-4121-a6e5-8abb802f7a17" status: 200 len: 1557 microversion: 2.1 time: 0.417291 Jul 18 10:29:45.026069 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 61/126] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:29:44 2022] GET /compute/v2.1/servers/db62c05e-28a8-4121-a6e5-8abb802f7a17 => generated 1557 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:29:45.031834 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-a51179da-967f-4e73-9b4c-ca224202caf2 tempest-DeleteServersTestJSON-1052419078 tempest-DeleteServersTestJSON-1052419078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0f993e44c624f65abae22540ce7dffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daab623e57e54081b262d4a8fe124f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:29:45.040404 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-a51179da-967f-4e73-9b4c-ca224202caf2 tempest-DeleteServersTestJSON-1052419078 tempest-DeleteServersTestJSON-1052419078-project] 10.222.0.33 "GET /compute/v2.1/servers/df938010-ebc5-429f-8499-4b55eff7cab9" status: 200 len: 1502 microversion: 2.1 time: 0.452895 Jul 18 10:29:45.042772 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-138c92e6-35c8-40ff-8825-9d5eec140aa4 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:29:45.054001 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-138c92e6-35c8-40ff-8825-9d5eec140aa4 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] [instance: db62c05e-28a8-4121-a6e5-8abb802f7a17] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:29:45.054165 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 66/127] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:29:44 2022] GET /compute/v2.1/servers/df938010-ebc5-429f-8499-4b55eff7cab9 => generated 1502 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:29:45.054249 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-138c92e6-35c8-40ff-8825-9d5eec140aa4 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:29:45.054249 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-138c92e6-35c8-40ff-8825-9d5eec140aa4 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:29:45.065178 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-138c92e6-35c8-40ff-8825-9d5eec140aa4 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:29:45.065645 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-138c92e6-35c8-40ff-8825-9d5eec140aa4 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:29:45.170084 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-66e039c9-46b6-46d8-9cbd-a8487860b412 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:29:45.173568 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-66e039c9-46b6-46d8-9cbd-a8487860b412 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] [instance: 78bb7f95-9846-4a59-9f77-a3fe69005eec] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:29:45.192691 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-66e039c9-46b6-46d8-9cbd-a8487860b412 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:29:45.193184 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-66e039c9-46b6-46d8-9cbd-a8487860b412 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:29:45.196401 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-66e039c9-46b6-46d8-9cbd-a8487860b412 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:29:45.196950 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-66e039c9-46b6-46d8-9cbd-a8487860b412 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:29:45.311321 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-138c92e6-35c8-40ff-8825-9d5eec140aa4 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] 10.222.0.33 "GET /compute/v2.1/servers/db62c05e-28a8-4121-a6e5-8abb802f7a17/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.272512 Jul 18 10:29:45.312268 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 62/128] 10.222.0.33 () {58 vars in 1274 bytes} [Mon Jul 18 10:29:45 2022] GET /compute/v2.1/servers/db62c05e-28a8-4121-a6e5-8abb802f7a17/os-interface => generated 285 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:29:45.317495 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-8f6067d2-225b-4c07-8183-6266e80b3139 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:29:45.329992 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-8f6067d2-225b-4c07-8183-6266e80b3139 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] [instance: dcb1b50b-9e62-4ff3-9875-3d4635597b45] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:29:45.348683 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-8f6067d2-225b-4c07-8183-6266e80b3139 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:29:45.351194 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-8f6067d2-225b-4c07-8183-6266e80b3139 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:29:45.353577 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-8f6067d2-225b-4c07-8183-6266e80b3139 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:29:45.354291 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-8f6067d2-225b-4c07-8183-6266e80b3139 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:29:45.481176 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-66e039c9-46b6-46d8-9cbd-a8487860b412 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a431c9708f4694bc0d514133e76088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a1921237622439bab89676e11477c13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:29:45.494088 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-66e039c9-46b6-46d8-9cbd-a8487860b412 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] 10.222.0.33 "GET /compute/v2.1/servers/78bb7f95-9846-4a59-9f77-a3fe69005eec" status: 200 len: 1520 microversion: 2.1 time: 0.328698 Jul 18 10:29:45.498370 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 67/129] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:29:45 2022] GET /compute/v2.1/servers/78bb7f95-9846-4a59-9f77-a3fe69005eec => generated 1520 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:29:45.776464 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-8f6067d2-225b-4c07-8183-6266e80b3139 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '986f90dfbad14324b3fffbd790d60a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e487deb7ff45bdbf2cc002d42d12a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:29:45.786057 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-8f6067d2-225b-4c07-8183-6266e80b3139 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] 10.222.0.33 "GET /compute/v2.1/servers/dcb1b50b-9e62-4ff3-9875-3d4635597b45" status: 200 len: 1361 microversion: 2.1 time: 0.472542 Jul 18 10:29:45.787675 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 63/130] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:29:45 2022] GET /compute/v2.1/servers/dcb1b50b-9e62-4ff3-9875-3d4635597b45 => generated 1361 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:29:46.517336 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-60757a27-d033-4903-9b4c-07f0b5e25a06 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:29:46.518054 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-60757a27-d033-4903-9b4c-07f0b5e25a06 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] [instance: 78bb7f95-9846-4a59-9f77-a3fe69005eec] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:29:46.528992 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-60757a27-d033-4903-9b4c-07f0b5e25a06 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:29:46.530627 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-60757a27-d033-4903-9b4c-07f0b5e25a06 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:29:46.531953 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-60757a27-d033-4903-9b4c-07f0b5e25a06 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:29:46.533235 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-60757a27-d033-4903-9b4c-07f0b5e25a06 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:29:46.725313 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-60757a27-d033-4903-9b4c-07f0b5e25a06 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a431c9708f4694bc0d514133e76088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a1921237622439bab89676e11477c13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:29:46.737701 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-60757a27-d033-4903-9b4c-07f0b5e25a06 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] 10.222.0.33 "GET /compute/v2.1/servers/78bb7f95-9846-4a59-9f77-a3fe69005eec" status: 200 len: 1520 microversion: 2.1 time: 0.226467 Jul 18 10:29:46.741071 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 68/131] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:29:46 2022] GET /compute/v2.1/servers/78bb7f95-9846-4a59-9f77-a3fe69005eec => generated 1520 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:29:46.772849 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-de43f9b7-1f67-4353-8c8c-fc7bb9cbc2e0 tempest-DeleteServersTestJSON-1052419078 tempest-DeleteServersTestJSON-1052419078-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "668ecf21-6d9a-47c5-9e42-7fecb8561945"}} {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:29:46.774520 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-de43f9b7-1f67-4353-8c8c-fc7bb9cbc2e0 tempest-DeleteServersTestJSON-1052419078 tempest-DeleteServersTestJSON-1052419078-project] [instance: df938010-ebc5-429f-8499-4b55eff7cab9] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:29:46.785633 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-de43f9b7-1f67-4353-8c8c-fc7bb9cbc2e0 tempest-DeleteServersTestJSON-1052419078 tempest-DeleteServersTestJSON-1052419078-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:29:46.786120 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-de43f9b7-1f67-4353-8c8c-fc7bb9cbc2e0 tempest-DeleteServersTestJSON-1052419078 tempest-DeleteServersTestJSON-1052419078-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:29:46.786924 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-de43f9b7-1f67-4353-8c8c-fc7bb9cbc2e0 tempest-DeleteServersTestJSON-1052419078 tempest-DeleteServersTestJSON-1052419078-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:29:46.787362 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-de43f9b7-1f67-4353-8c8c-fc7bb9cbc2e0 tempest-DeleteServersTestJSON-1052419078 tempest-DeleteServersTestJSON-1052419078-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:29:46.803095 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-b41b77b3-801c-44f2-972b-d445f782c76f tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:29:46.804226 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-b41b77b3-801c-44f2-972b-d445f782c76f tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] [instance: dcb1b50b-9e62-4ff3-9875-3d4635597b45] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:29:46.822350 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-b41b77b3-801c-44f2-972b-d445f782c76f tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:29:46.822350 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-b41b77b3-801c-44f2-972b-d445f782c76f tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:29:46.822350 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-b41b77b3-801c-44f2-972b-d445f782c76f tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:29:46.822350 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-b41b77b3-801c-44f2-972b-d445f782c76f tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:29:47.106393 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-b41b77b3-801c-44f2-972b-d445f782c76f tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '986f90dfbad14324b3fffbd790d60a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e487deb7ff45bdbf2cc002d42d12a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:29:47.119086 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-b41b77b3-801c-44f2-972b-d445f782c76f tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] 10.222.0.33 "GET /compute/v2.1/servers/dcb1b50b-9e62-4ff3-9875-3d4635597b45" status: 200 len: 1546 microversion: 2.1 time: 0.319608 Jul 18 10:29:47.120193 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 69/132] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:29:46 2022] GET /compute/v2.1/servers/dcb1b50b-9e62-4ff3-9875-3d4635597b45 => generated 1546 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:29:47.125711 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [req-700c108e-69f7-43f5-b078-d3b16ac78268 req-bb105079-54ff-4869-9fa0-b83e994a3247 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "db62c05e-28a8-4121-a6e5-8abb802f7a17", "tag": "f97d9284-09c3-4aa3-8f54-5bb526b9fe08"}]} {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:29:47.136771 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [req-700c108e-69f7-43f5-b078-d3b16ac78268 req-bb105079-54ff-4869-9fa0-b83e994a3247 service nova] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:29:47.137666 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [req-700c108e-69f7-43f5-b078-d3b16ac78268 req-bb105079-54ff-4869-9fa0-b83e994a3247 service nova] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:29:47.152660 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.compute.server_external_events [req-700c108e-69f7-43f5-b078-d3b16ac78268 req-bb105079-54ff-4869-9fa0-b83e994a3247 service nova] Creating event network-changed:f97d9284-09c3-4aa3-8f54-5bb526b9fe08 for instance db62c05e-28a8-4121-a6e5-8abb802f7a17 on hv-cinder-83754 Jul 18 10:29:47.165399 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [req-700c108e-69f7-43f5-b078-d3b16ac78268 req-bb105079-54ff-4869-9fa0-b83e994a3247 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042943 Jul 18 10:29:47.167239 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 70/133] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jul 18 10:29:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:29:47.174448 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-f58f2ab4-866c-4078-b2b9-d622eec60a9e tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:29:47.177096 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-f58f2ab4-866c-4078-b2b9-d622eec60a9e tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] [instance: dcb1b50b-9e62-4ff3-9875-3d4635597b45] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:29:47.184605 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-f58f2ab4-866c-4078-b2b9-d622eec60a9e tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:29:47.185337 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-f58f2ab4-866c-4078-b2b9-d622eec60a9e tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:29:47.186941 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-f58f2ab4-866c-4078-b2b9-d622eec60a9e tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:29:47.187616 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-f58f2ab4-866c-4078-b2b9-d622eec60a9e tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:29:47.334772 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-de43f9b7-1f67-4353-8c8c-fc7bb9cbc2e0 tempest-DeleteServersTestJSON-1052419078 tempest-DeleteServersTestJSON-1052419078-project] 10.222.0.33 "POST /compute/v2.1/servers/df938010-ebc5-429f-8499-4b55eff7cab9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.567109 Jul 18 10:29:47.335514 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 64/134] 10.222.0.33 () {60 vars in 1322 bytes} [Mon Jul 18 10:29:46 2022] POST /compute/v2.1/servers/df938010-ebc5-429f-8499-4b55eff7cab9/os-volume_attachments => generated 194 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:29:47.369203 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-f58f2ab4-866c-4078-b2b9-d622eec60a9e tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] 10.222.0.33 "GET /compute/v2.1/servers/dcb1b50b-9e62-4ff3-9875-3d4635597b45/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.200134 Jul 18 10:29:47.375432 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 71/135] 10.222.0.33 () {58 vars in 1274 bytes} [Mon Jul 18 10:29:47 2022] GET /compute/v2.1/servers/dcb1b50b-9e62-4ff3-9875-3d4635597b45/os-interface => generated 284 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:29:47.759098 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-0a89ed6d-18f5-4041-bfb0-f2d476359da0 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:29:47.760276 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-0a89ed6d-18f5-4041-bfb0-f2d476359da0 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] [instance: 78bb7f95-9846-4a59-9f77-a3fe69005eec] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:29:47.780309 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-0a89ed6d-18f5-4041-bfb0-f2d476359da0 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:29:47.780920 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-0a89ed6d-18f5-4041-bfb0-f2d476359da0 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:29:47.786142 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-0a89ed6d-18f5-4041-bfb0-f2d476359da0 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:29:47.786142 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-0a89ed6d-18f5-4041-bfb0-f2d476359da0 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:29:48.339807 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-0a89ed6d-18f5-4041-bfb0-f2d476359da0 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a431c9708f4694bc0d514133e76088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a1921237622439bab89676e11477c13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:29:48.350048 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-0a89ed6d-18f5-4041-bfb0-f2d476359da0 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] 10.222.0.33 "GET /compute/v2.1/servers/78bb7f95-9846-4a59-9f77-a3fe69005eec" status: 200 len: 1520 microversion: 2.1 time: 0.596435 Jul 18 10:29:48.351115 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 65/136] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:29:47 2022] GET /compute/v2.1/servers/78bb7f95-9846-4a59-9f77-a3fe69005eec => generated 1520 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:29:49.369306 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-9d272ca5-acb2-420c-b92c-6666e825edd3 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:29:49.369953 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-9d272ca5-acb2-420c-b92c-6666e825edd3 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] [instance: 78bb7f95-9846-4a59-9f77-a3fe69005eec] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:29:49.381281 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-9d272ca5-acb2-420c-b92c-6666e825edd3 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:29:49.381755 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-9d272ca5-acb2-420c-b92c-6666e825edd3 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:29:49.382582 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-9d272ca5-acb2-420c-b92c-6666e825edd3 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:29:49.382922 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-9d272ca5-acb2-420c-b92c-6666e825edd3 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:29:49.641583 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [req-34875a58-8eeb-4c56-a2e1-e8a70d0cb185 req-4d9f8381-2105-42b9-9070-013aec4bb1dd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dcb1b50b-9e62-4ff3-9875-3d4635597b45", "tag": "2be9cb89-71c6-44bf-b559-2446d61bca60"}]} {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:29:49.666091 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [req-34875a58-8eeb-4c56-a2e1-e8a70d0cb185 req-4d9f8381-2105-42b9-9070-013aec4bb1dd service nova] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:29:49.666553 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [req-34875a58-8eeb-4c56-a2e1-e8a70d0cb185 req-4d9f8381-2105-42b9-9070-013aec4bb1dd service nova] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:29:49.715466 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.compute.server_external_events [req-34875a58-8eeb-4c56-a2e1-e8a70d0cb185 req-4d9f8381-2105-42b9-9070-013aec4bb1dd service nova] Creating event network-changed:2be9cb89-71c6-44bf-b559-2446d61bca60 for instance dcb1b50b-9e62-4ff3-9875-3d4635597b45 on hv-cinder-83754 Jul 18 10:29:49.726769 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [req-34875a58-8eeb-4c56-a2e1-e8a70d0cb185 req-4d9f8381-2105-42b9-9070-013aec4bb1dd service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088762 Jul 18 10:29:49.735560 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 66/137] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jul 18 10:29:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 10:29:49.740779 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-9d272ca5-acb2-420c-b92c-6666e825edd3 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a431c9708f4694bc0d514133e76088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a1921237622439bab89676e11477c13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:29:49.755383 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-9d272ca5-acb2-420c-b92c-6666e825edd3 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] 10.222.0.33 "GET /compute/v2.1/servers/78bb7f95-9846-4a59-9f77-a3fe69005eec" status: 200 len: 1520 microversion: 2.1 time: 0.386120 Jul 18 10:29:49.771399 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 72/138] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:29:49 2022] GET /compute/v2.1/servers/78bb7f95-9846-4a59-9f77-a3fe69005eec => generated 1520 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:29:50.781327 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-6574fc3e-7a26-4519-bf7a-75c056cf0da6 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:29:50.782575 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-6574fc3e-7a26-4519-bf7a-75c056cf0da6 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] [instance: 78bb7f95-9846-4a59-9f77-a3fe69005eec] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:29:50.793314 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-6574fc3e-7a26-4519-bf7a-75c056cf0da6 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:29:50.793968 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-6574fc3e-7a26-4519-bf7a-75c056cf0da6 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:29:50.795078 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-6574fc3e-7a26-4519-bf7a-75c056cf0da6 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:29:50.795705 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-6574fc3e-7a26-4519-bf7a-75c056cf0da6 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:29:50.995789 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-6574fc3e-7a26-4519-bf7a-75c056cf0da6 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a431c9708f4694bc0d514133e76088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a1921237622439bab89676e11477c13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:29:51.005617 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-6574fc3e-7a26-4519-bf7a-75c056cf0da6 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] 10.222.0.33 "GET /compute/v2.1/servers/78bb7f95-9846-4a59-9f77-a3fe69005eec" status: 200 len: 1520 microversion: 2.1 time: 0.228838 Jul 18 10:29:51.009286 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 67/139] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:29:50 2022] GET /compute/v2.1/servers/78bb7f95-9846-4a59-9f77-a3fe69005eec => generated 1520 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:29:52.030166 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-d4ced518-a8c5-4ffc-b074-66b9f5ba577f tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:29:52.031411 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-d4ced518-a8c5-4ffc-b074-66b9f5ba577f tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] [instance: 78bb7f95-9846-4a59-9f77-a3fe69005eec] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:29:52.040769 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-d4ced518-a8c5-4ffc-b074-66b9f5ba577f tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:29:52.041498 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-d4ced518-a8c5-4ffc-b074-66b9f5ba577f tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:29:52.042841 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-d4ced518-a8c5-4ffc-b074-66b9f5ba577f tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:29:52.043453 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-d4ced518-a8c5-4ffc-b074-66b9f5ba577f tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:29:52.194179 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-d4ced518-a8c5-4ffc-b074-66b9f5ba577f tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a431c9708f4694bc0d514133e76088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a1921237622439bab89676e11477c13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:29:52.202283 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-d4ced518-a8c5-4ffc-b074-66b9f5ba577f tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] 10.222.0.33 "GET /compute/v2.1/servers/78bb7f95-9846-4a59-9f77-a3fe69005eec" status: 200 len: 1520 microversion: 2.1 time: 0.180130 Jul 18 10:29:52.202939 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 73/140] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:29:52 2022] GET /compute/v2.1/servers/78bb7f95-9846-4a59-9f77-a3fe69005eec => generated 1520 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:29:53.223312 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-c79232f5-0414-444f-8c8b-3f8e5aa87c6e tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:29:53.224589 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-c79232f5-0414-444f-8c8b-3f8e5aa87c6e tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] [instance: 78bb7f95-9846-4a59-9f77-a3fe69005eec] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:29:53.239774 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-c79232f5-0414-444f-8c8b-3f8e5aa87c6e tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:29:53.240224 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-c79232f5-0414-444f-8c8b-3f8e5aa87c6e tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:29:53.241027 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-c79232f5-0414-444f-8c8b-3f8e5aa87c6e tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:29:53.241461 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-c79232f5-0414-444f-8c8b-3f8e5aa87c6e tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:29:53.551286 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-c79232f5-0414-444f-8c8b-3f8e5aa87c6e tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a431c9708f4694bc0d514133e76088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a1921237622439bab89676e11477c13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:29:53.566741 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-c79232f5-0414-444f-8c8b-3f8e5aa87c6e tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] 10.222.0.33 "GET /compute/v2.1/servers/78bb7f95-9846-4a59-9f77-a3fe69005eec" status: 200 len: 1520 microversion: 2.1 time: 0.349535 Jul 18 10:29:53.568456 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 68/141] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:29:53 2022] GET /compute/v2.1/servers/78bb7f95-9846-4a59-9f77-a3fe69005eec => generated 1520 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:29:53.766640 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-0cce5096-6ee3-40a0-92da-c6bce32a39b1 tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1252991379", "imageRef": "2cb02169-9999-411b-8c74-f88c068960fc", "flavorRef": "452", "networks": [{"uuid": "474c975d-13fe-4438-9075-b3e20c4cc132"}]}} {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:29:53.821641 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.network.neutron [None req-0cce5096-6ee3-40a0-92da-c6bce32a39b1 tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] validate_networks() for [('474c975d-13fe-4438-9075-b3e20c4cc132', None, None, None, None, None)] {{(pid=117879) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 10:29:54.509571 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.virt.hardware [None req-0cce5096-6ee3-40a0-92da-c6bce32a39b1 tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] Flavor limits 0:0:0 {{(pid=117879) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 10:29:54.510292 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.virt.hardware [None req-0cce5096-6ee3-40a0-92da-c6bce32a39b1 tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] Image limits 0:0:0 {{(pid=117879) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 10:29:54.511418 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.virt.hardware [None req-0cce5096-6ee3-40a0-92da-c6bce32a39b1 tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] Flavor pref 0:0:0 {{(pid=117879) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 10:29:54.512078 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.virt.hardware [None req-0cce5096-6ee3-40a0-92da-c6bce32a39b1 tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] Image pref 0:0:0 {{(pid=117879) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 10:29:54.512704 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.virt.hardware [None req-0cce5096-6ee3-40a0-92da-c6bce32a39b1 tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117879) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 10:29:54.522702 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-0cce5096-6ee3-40a0-92da-c6bce32a39b1 tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:29:54.523270 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-0cce5096-6ee3-40a0-92da-c6bce32a39b1 tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:29:54.524318 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-0cce5096-6ee3-40a0-92da-c6bce32a39b1 tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:29:54.524855 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-0cce5096-6ee3-40a0-92da-c6bce32a39b1 tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:29:54.544983 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.quota [None req-0cce5096-6ee3-40a0-92da-c6bce32a39b1 tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] Getting quotas for project 9698a0142f494095a93a4e804437bc32. Resources: {'ram', 'cores', 'instances'} {{(pid=117879) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 10:29:54.549451 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.quota [None req-0cce5096-6ee3-40a0-92da-c6bce32a39b1 tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] Getting quotas for user bc233897770f47e5bd40fb03afabe49c and project 9698a0142f494095a93a4e804437bc32. Resources: {'ram', 'cores', 'instances'} {{(pid=117879) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 10:29:54.564493 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-0cce5096-6ee3-40a0-92da-c6bce32a39b1 tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] Going to run 1 instances... {{(pid=117879) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 10:29:54.567336 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-0cce5096-6ee3-40a0-92da-c6bce32a39b1 tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] [instance: 150a6155-aec7-449b-88f4-aab89d373ddc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2cb02169-9999-411b-8c74-f88c068960fc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117879) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 10:29:54.587538 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-8686e80d-fb6c-4dfe-a60a-49016e5da127 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:29:54.588253 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-8686e80d-fb6c-4dfe-a60a-49016e5da127 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] [instance: 78bb7f95-9846-4a59-9f77-a3fe69005eec] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:29:54.595905 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-8686e80d-fb6c-4dfe-a60a-49016e5da127 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:29:54.596582 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-8686e80d-fb6c-4dfe-a60a-49016e5da127 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:29:54.597516 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-8686e80d-fb6c-4dfe-a60a-49016e5da127 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:29:54.598081 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-8686e80d-fb6c-4dfe-a60a-49016e5da127 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:29:54.619216 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-0cce5096-6ee3-40a0-92da-c6bce32a39b1 tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.856328 Jul 18 10:29:54.620864 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 74/142] 10.222.0.33 () {60 vars in 1146 bytes} [Mon Jul 18 10:29:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 858 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 10:29:54.630718 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-505dd52d-8d8c-4350-9a3b-00ff82f5b93f tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:29:54.631574 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-505dd52d-8d8c-4350-9a3b-00ff82f5b93f tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] [instance: 150a6155-aec7-449b-88f4-aab89d373ddc] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:29:54.693480 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-505dd52d-8d8c-4350-9a3b-00ff82f5b93f tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc233897770f47e5bd40fb03afabe49c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9698a0142f494095a93a4e804437bc32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:29:54.701251 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-505dd52d-8d8c-4350-9a3b-00ff82f5b93f tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] 10.222.0.33 "GET /compute/v2.1/servers/150a6155-aec7-449b-88f4-aab89d373ddc" status: 200 len: 1214 microversion: 2.1 time: 0.074601 Jul 18 10:29:54.702137 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 75/143] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:29:54 2022] GET /compute/v2.1/servers/150a6155-aec7-449b-88f4-aab89d373ddc => generated 1214 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:29:54.833582 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-8686e80d-fb6c-4dfe-a60a-49016e5da127 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a431c9708f4694bc0d514133e76088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a1921237622439bab89676e11477c13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:29:54.843952 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-8686e80d-fb6c-4dfe-a60a-49016e5da127 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] 10.222.0.33 "GET /compute/v2.1/servers/78bb7f95-9846-4a59-9f77-a3fe69005eec" status: 200 len: 1520 microversion: 2.1 time: 0.261378 Jul 18 10:29:54.844582 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 69/144] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:29:54 2022] GET /compute/v2.1/servers/78bb7f95-9846-4a59-9f77-a3fe69005eec => generated 1520 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:29:55.720040 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-86e552c6-5bc0-4f16-97fe-5daeaa771806 tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:29:55.720674 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-86e552c6-5bc0-4f16-97fe-5daeaa771806 tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] [instance: 150a6155-aec7-449b-88f4-aab89d373ddc] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:29:55.723265 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG dbcounter [-] [117879] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=3 {{(pid=117879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:29:55.733678 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-86e552c6-5bc0-4f16-97fe-5daeaa771806 tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:29:55.741779 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-86e552c6-5bc0-4f16-97fe-5daeaa771806 tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:29:55.742838 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-86e552c6-5bc0-4f16-97fe-5daeaa771806 tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:29:55.743346 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-86e552c6-5bc0-4f16-97fe-5daeaa771806 tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:29:55.863076 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-078a31ae-82ee-41b2-9096-b931ef82d9ab tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:29:55.863927 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-078a31ae-82ee-41b2-9096-b931ef82d9ab tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] [instance: 78bb7f95-9846-4a59-9f77-a3fe69005eec] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:29:55.874246 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-078a31ae-82ee-41b2-9096-b931ef82d9ab tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:29:55.874708 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-078a31ae-82ee-41b2-9096-b931ef82d9ab tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:29:55.875540 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-078a31ae-82ee-41b2-9096-b931ef82d9ab tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:29:55.876900 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-078a31ae-82ee-41b2-9096-b931ef82d9ab tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:29:55.882282 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-86e552c6-5bc0-4f16-97fe-5daeaa771806 tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc233897770f47e5bd40fb03afabe49c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9698a0142f494095a93a4e804437bc32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:29:55.895167 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-86e552c6-5bc0-4f16-97fe-5daeaa771806 tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] 10.222.0.33 "GET /compute/v2.1/servers/150a6155-aec7-449b-88f4-aab89d373ddc" status: 200 len: 1218 microversion: 2.1 time: 0.179387 Jul 18 10:29:55.896119 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 76/145] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:29:55 2022] GET /compute/v2.1/servers/150a6155-aec7-449b-88f4-aab89d373ddc => generated 1218 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:29:56.026317 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-078a31ae-82ee-41b2-9096-b931ef82d9ab tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a431c9708f4694bc0d514133e76088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a1921237622439bab89676e11477c13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:29:56.034618 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-078a31ae-82ee-41b2-9096-b931ef82d9ab tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] 10.222.0.33 "GET /compute/v2.1/servers/78bb7f95-9846-4a59-9f77-a3fe69005eec" status: 200 len: 1520 microversion: 2.1 time: 0.177181 Jul 18 10:29:56.035200 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 70/146] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:29:55 2022] GET /compute/v2.1/servers/78bb7f95-9846-4a59-9f77-a3fe69005eec => generated 1520 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:29:56.492574 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-b907b9ee-f385-4da3-b57d-035fe83418f4 tempest-DeleteServersTestJSON-1052419078 tempest-DeleteServersTestJSON-1052419078-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:29:56.493070 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-b907b9ee-f385-4da3-b57d-035fe83418f4 tempest-DeleteServersTestJSON-1052419078 tempest-DeleteServersTestJSON-1052419078-project] [instance: df938010-ebc5-429f-8499-4b55eff7cab9] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:29:56.499005 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-b907b9ee-f385-4da3-b57d-035fe83418f4 tempest-DeleteServersTestJSON-1052419078 tempest-DeleteServersTestJSON-1052419078-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:29:56.499454 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-b907b9ee-f385-4da3-b57d-035fe83418f4 tempest-DeleteServersTestJSON-1052419078 tempest-DeleteServersTestJSON-1052419078-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:29:56.500212 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-b907b9ee-f385-4da3-b57d-035fe83418f4 tempest-DeleteServersTestJSON-1052419078 tempest-DeleteServersTestJSON-1052419078-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:29:56.500674 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-b907b9ee-f385-4da3-b57d-035fe83418f4 tempest-DeleteServersTestJSON-1052419078 tempest-DeleteServersTestJSON-1052419078-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:29:56.520043 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG dbcounter [-] [117879] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:29:56.530237 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-b907b9ee-f385-4da3-b57d-035fe83418f4 tempest-DeleteServersTestJSON-1052419078 tempest-DeleteServersTestJSON-1052419078-project] [instance: df938010-ebc5-429f-8499-4b55eff7cab9] Going to try to terminate instance {{(pid=117879) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 10:29:56.619471 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-b907b9ee-f385-4da3-b57d-035fe83418f4 tempest-DeleteServersTestJSON-1052419078 tempest-DeleteServersTestJSON-1052419078-project] 10.222.0.33 "DELETE /compute/v2.1/servers/df938010-ebc5-429f-8499-4b55eff7cab9" status: 204 len: 0 microversion: 2.1 time: 0.130384 Jul 18 10:29:56.620054 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 77/147] 10.222.0.33 () {58 vars in 1238 bytes} [Mon Jul 18 10:29:56 2022] DELETE /compute/v2.1/servers/df938010-ebc5-429f-8499-4b55eff7cab9 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 10:29:56.628003 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-6f5c4409-17b7-46d8-8d53-bb7948085572 tempest-DeleteServersTestJSON-1052419078 tempest-DeleteServersTestJSON-1052419078-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:29:56.628637 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-6f5c4409-17b7-46d8-8d53-bb7948085572 tempest-DeleteServersTestJSON-1052419078 tempest-DeleteServersTestJSON-1052419078-project] [instance: df938010-ebc5-429f-8499-4b55eff7cab9] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:29:56.634509 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-6f5c4409-17b7-46d8-8d53-bb7948085572 tempest-DeleteServersTestJSON-1052419078 tempest-DeleteServersTestJSON-1052419078-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:29:56.634957 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-6f5c4409-17b7-46d8-8d53-bb7948085572 tempest-DeleteServersTestJSON-1052419078 tempest-DeleteServersTestJSON-1052419078-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:29:56.635707 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-6f5c4409-17b7-46d8-8d53-bb7948085572 tempest-DeleteServersTestJSON-1052419078 tempest-DeleteServersTestJSON-1052419078-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:29:56.636141 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-6f5c4409-17b7-46d8-8d53-bb7948085572 tempest-DeleteServersTestJSON-1052419078 tempest-DeleteServersTestJSON-1052419078-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:29:56.804956 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-6f5c4409-17b7-46d8-8d53-bb7948085572 tempest-DeleteServersTestJSON-1052419078 tempest-DeleteServersTestJSON-1052419078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0f993e44c624f65abae22540ce7dffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daab623e57e54081b262d4a8fe124f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:29:56.814792 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-6f5c4409-17b7-46d8-8d53-bb7948085572 tempest-DeleteServersTestJSON-1052419078 tempest-DeleteServersTestJSON-1052419078-project] 10.222.0.33 "GET /compute/v2.1/servers/df938010-ebc5-429f-8499-4b55eff7cab9" status: 200 len: 1554 microversion: 2.1 time: 0.190512 Jul 18 10:29:56.816824 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 71/148] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:29:56 2022] GET /compute/v2.1/servers/df938010-ebc5-429f-8499-4b55eff7cab9 => generated 1554 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:29:56.915372 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-773a0f19-d929-4e77-b645-fea1d892f5f9 tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:29:56.916094 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-773a0f19-d929-4e77-b645-fea1d892f5f9 tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] [instance: 150a6155-aec7-449b-88f4-aab89d373ddc] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:29:56.922697 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-773a0f19-d929-4e77-b645-fea1d892f5f9 tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:29:56.923262 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-773a0f19-d929-4e77-b645-fea1d892f5f9 tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:29:56.923950 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-773a0f19-d929-4e77-b645-fea1d892f5f9 tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:29:56.924460 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-773a0f19-d929-4e77-b645-fea1d892f5f9 tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:29:56.991234 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-773a0f19-d929-4e77-b645-fea1d892f5f9 tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc233897770f47e5bd40fb03afabe49c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9698a0142f494095a93a4e804437bc32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:29:56.998924 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-773a0f19-d929-4e77-b645-fea1d892f5f9 tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] 10.222.0.33 "GET /compute/v2.1/servers/150a6155-aec7-449b-88f4-aab89d373ddc" status: 200 len: 1274 microversion: 2.1 time: 0.088069 Jul 18 10:29:56.999651 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 78/149] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:29:56 2022] GET /compute/v2.1/servers/150a6155-aec7-449b-88f4-aab89d373ddc => generated 1274 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:29:57.052042 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-a1a65e9d-f9a2-4176-81a8-160245e91a9f tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:29:57.052814 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-a1a65e9d-f9a2-4176-81a8-160245e91a9f tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] [instance: 78bb7f95-9846-4a59-9f77-a3fe69005eec] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:29:57.059359 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-a1a65e9d-f9a2-4176-81a8-160245e91a9f tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:29:57.059807 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-a1a65e9d-f9a2-4176-81a8-160245e91a9f tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:29:57.060595 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-a1a65e9d-f9a2-4176-81a8-160245e91a9f tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:29:57.061027 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-a1a65e9d-f9a2-4176-81a8-160245e91a9f tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:29:57.209678 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-a1a65e9d-f9a2-4176-81a8-160245e91a9f tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a431c9708f4694bc0d514133e76088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a1921237622439bab89676e11477c13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:29:57.218557 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-a1a65e9d-f9a2-4176-81a8-160245e91a9f tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] 10.222.0.33 "GET /compute/v2.1/servers/78bb7f95-9846-4a59-9f77-a3fe69005eec" status: 200 len: 1520 microversion: 2.1 time: 0.170891 Jul 18 10:29:57.219112 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 72/150] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:29:57 2022] GET /compute/v2.1/servers/78bb7f95-9846-4a59-9f77-a3fe69005eec => generated 1520 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:29:57.834239 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-213f37ae-04bc-44b0-b6cc-eda475f20816 tempest-DeleteServersTestJSON-1052419078 tempest-DeleteServersTestJSON-1052419078-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:29:57.834958 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-213f37ae-04bc-44b0-b6cc-eda475f20816 tempest-DeleteServersTestJSON-1052419078 tempest-DeleteServersTestJSON-1052419078-project] [instance: df938010-ebc5-429f-8499-4b55eff7cab9] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:29:57.841595 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-213f37ae-04bc-44b0-b6cc-eda475f20816 tempest-DeleteServersTestJSON-1052419078 tempest-DeleteServersTestJSON-1052419078-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:29:57.842045 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-213f37ae-04bc-44b0-b6cc-eda475f20816 tempest-DeleteServersTestJSON-1052419078 tempest-DeleteServersTestJSON-1052419078-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:29:57.842802 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-213f37ae-04bc-44b0-b6cc-eda475f20816 tempest-DeleteServersTestJSON-1052419078 tempest-DeleteServersTestJSON-1052419078-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:29:57.843231 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-213f37ae-04bc-44b0-b6cc-eda475f20816 tempest-DeleteServersTestJSON-1052419078 tempest-DeleteServersTestJSON-1052419078-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:29:57.995636 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-213f37ae-04bc-44b0-b6cc-eda475f20816 tempest-DeleteServersTestJSON-1052419078 tempest-DeleteServersTestJSON-1052419078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0f993e44c624f65abae22540ce7dffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daab623e57e54081b262d4a8fe124f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:29:58.004291 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-213f37ae-04bc-44b0-b6cc-eda475f20816 tempest-DeleteServersTestJSON-1052419078 tempest-DeleteServersTestJSON-1052419078-project] 10.222.0.33 "GET /compute/v2.1/servers/df938010-ebc5-429f-8499-4b55eff7cab9" status: 200 len: 1554 microversion: 2.1 time: 0.174729 Jul 18 10:29:58.005051 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 79/151] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:29:57 2022] GET /compute/v2.1/servers/df938010-ebc5-429f-8499-4b55eff7cab9 => generated 1554 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:29:58.015878 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-cec2715f-25de-4739-bdd6-89a5bb96539a tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:29:58.016612 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-cec2715f-25de-4739-bdd6-89a5bb96539a tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] [instance: 150a6155-aec7-449b-88f4-aab89d373ddc] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:29:58.023714 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-cec2715f-25de-4739-bdd6-89a5bb96539a tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:29:58.024285 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-cec2715f-25de-4739-bdd6-89a5bb96539a tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:29:58.025190 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-cec2715f-25de-4739-bdd6-89a5bb96539a tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:29:58.025948 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-cec2715f-25de-4739-bdd6-89a5bb96539a tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:29:58.031298 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG dbcounter [-] [117880] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:29:58.095200 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-cec2715f-25de-4739-bdd6-89a5bb96539a tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc233897770f47e5bd40fb03afabe49c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9698a0142f494095a93a4e804437bc32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:29:58.103140 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-cec2715f-25de-4739-bdd6-89a5bb96539a tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] 10.222.0.33 "GET /compute/v2.1/servers/150a6155-aec7-449b-88f4-aab89d373ddc" status: 200 len: 1274 microversion: 2.1 time: 0.091696 Jul 18 10:29:58.103959 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 73/152] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:29:58 2022] GET /compute/v2.1/servers/150a6155-aec7-449b-88f4-aab89d373ddc => generated 1274 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:29:58.236719 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-78c0bc74-ae28-4a4d-bd66-f3fbcd67aab1 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:29:58.237616 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-78c0bc74-ae28-4a4d-bd66-f3fbcd67aab1 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] [instance: 78bb7f95-9846-4a59-9f77-a3fe69005eec] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:29:58.243969 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-78c0bc74-ae28-4a4d-bd66-f3fbcd67aab1 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:29:58.244481 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-78c0bc74-ae28-4a4d-bd66-f3fbcd67aab1 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:29:58.245282 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-78c0bc74-ae28-4a4d-bd66-f3fbcd67aab1 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:29:58.245715 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-78c0bc74-ae28-4a4d-bd66-f3fbcd67aab1 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:29:58.445042 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-78c0bc74-ae28-4a4d-bd66-f3fbcd67aab1 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a431c9708f4694bc0d514133e76088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a1921237622439bab89676e11477c13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:29:58.453011 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-78c0bc74-ae28-4a4d-bd66-f3fbcd67aab1 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] 10.222.0.33 "GET /compute/v2.1/servers/78bb7f95-9846-4a59-9f77-a3fe69005eec" status: 200 len: 1520 microversion: 2.1 time: 0.220814 Jul 18 10:29:58.465267 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 80/153] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:29:58 2022] GET /compute/v2.1/servers/78bb7f95-9846-4a59-9f77-a3fe69005eec => generated 1520 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:29:59.024382 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-158da71f-1d9f-45df-afdd-17eba9e7c379 tempest-DeleteServersTestJSON-1052419078 tempest-DeleteServersTestJSON-1052419078-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:29:59.026116 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-158da71f-1d9f-45df-afdd-17eba9e7c379 tempest-DeleteServersTestJSON-1052419078 tempest-DeleteServersTestJSON-1052419078-project] [instance: df938010-ebc5-429f-8499-4b55eff7cab9] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:29:59.033321 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-158da71f-1d9f-45df-afdd-17eba9e7c379 tempest-DeleteServersTestJSON-1052419078 tempest-DeleteServersTestJSON-1052419078-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:29:59.034611 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-158da71f-1d9f-45df-afdd-17eba9e7c379 tempest-DeleteServersTestJSON-1052419078 tempest-DeleteServersTestJSON-1052419078-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:29:59.035629 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-158da71f-1d9f-45df-afdd-17eba9e7c379 tempest-DeleteServersTestJSON-1052419078 tempest-DeleteServersTestJSON-1052419078-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:29:59.036263 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-158da71f-1d9f-45df-afdd-17eba9e7c379 tempest-DeleteServersTestJSON-1052419078 tempest-DeleteServersTestJSON-1052419078-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:29:59.121434 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-58ca2c81-3101-49d0-ba04-fa2194f7bbdf tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:29:59.122944 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-58ca2c81-3101-49d0-ba04-fa2194f7bbdf tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] [instance: 150a6155-aec7-449b-88f4-aab89d373ddc] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:29:59.133150 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-58ca2c81-3101-49d0-ba04-fa2194f7bbdf tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:29:59.133695 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-58ca2c81-3101-49d0-ba04-fa2194f7bbdf tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:29:59.135682 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-58ca2c81-3101-49d0-ba04-fa2194f7bbdf tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:29:59.136472 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-58ca2c81-3101-49d0-ba04-fa2194f7bbdf tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:29:59.284841 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-58ca2c81-3101-49d0-ba04-fa2194f7bbdf tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc233897770f47e5bd40fb03afabe49c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9698a0142f494095a93a4e804437bc32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:29:59.293753 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-58ca2c81-3101-49d0-ba04-fa2194f7bbdf tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] 10.222.0.33 "GET /compute/v2.1/servers/150a6155-aec7-449b-88f4-aab89d373ddc" status: 200 len: 1272 microversion: 2.1 time: 0.176886 Jul 18 10:29:59.294428 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 81/154] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:29:59 2022] GET /compute/v2.1/servers/150a6155-aec7-449b-88f4-aab89d373ddc => generated 1272 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:29:59.482020 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-65573c9c-2d6d-4abd-8c92-3d62e894ee38 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:29:59.482941 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-65573c9c-2d6d-4abd-8c92-3d62e894ee38 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] [instance: 78bb7f95-9846-4a59-9f77-a3fe69005eec] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:29:59.500109 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-65573c9c-2d6d-4abd-8c92-3d62e894ee38 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:29:59.500438 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-65573c9c-2d6d-4abd-8c92-3d62e894ee38 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:29:59.501253 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-65573c9c-2d6d-4abd-8c92-3d62e894ee38 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:29:59.501695 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-65573c9c-2d6d-4abd-8c92-3d62e894ee38 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:29:59.506833 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-158da71f-1d9f-45df-afdd-17eba9e7c379 tempest-DeleteServersTestJSON-1052419078 tempest-DeleteServersTestJSON-1052419078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0f993e44c624f65abae22540ce7dffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daab623e57e54081b262d4a8fe124f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:29:59.527906 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-158da71f-1d9f-45df-afdd-17eba9e7c379 tempest-DeleteServersTestJSON-1052419078 tempest-DeleteServersTestJSON-1052419078-project] 10.222.0.33 "GET /compute/v2.1/servers/df938010-ebc5-429f-8499-4b55eff7cab9" status: 200 len: 1554 microversion: 2.1 time: 0.507772 Jul 18 10:29:59.530336 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 74/155] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:29:59 2022] GET /compute/v2.1/servers/df938010-ebc5-429f-8499-4b55eff7cab9 => generated 1554 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:29:59.876555 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-65573c9c-2d6d-4abd-8c92-3d62e894ee38 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a431c9708f4694bc0d514133e76088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a1921237622439bab89676e11477c13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:29:59.886053 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-65573c9c-2d6d-4abd-8c92-3d62e894ee38 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] 10.222.0.33 "GET /compute/v2.1/servers/78bb7f95-9846-4a59-9f77-a3fe69005eec" status: 200 len: 1520 microversion: 2.1 time: 0.408421 Jul 18 10:29:59.886624 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 82/156] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:29:59 2022] GET /compute/v2.1/servers/78bb7f95-9846-4a59-9f77-a3fe69005eec => generated 1520 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:30:00.217767 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [req-2ac1ffc9-1389-4d8c-871f-38bc40e52ae5 req-668e62fc-0593-43fd-adff-b5133e62a52b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df938010-ebc5-429f-8499-4b55eff7cab9", "name": "network-vif-deleted", "tag": "b4d3e21d-6206-4ae8-99b7-004371bb68f2"}]} {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:30:00.249377 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [req-2ac1ffc9-1389-4d8c-871f-38bc40e52ae5 req-668e62fc-0593-43fd-adff-b5133e62a52b service nova] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:30:00.250004 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [req-2ac1ffc9-1389-4d8c-871f-38bc40e52ae5 req-668e62fc-0593-43fd-adff-b5133e62a52b service nova] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:30:00.267539 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.compute.server_external_events [req-2ac1ffc9-1389-4d8c-871f-38bc40e52ae5 req-668e62fc-0593-43fd-adff-b5133e62a52b service nova] Creating event network-vif-deleted:b4d3e21d-6206-4ae8-99b7-004371bb68f2 for instance df938010-ebc5-429f-8499-4b55eff7cab9 on hv-cinder-83754 Jul 18 10:30:00.275204 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [req-2ac1ffc9-1389-4d8c-871f-38bc40e52ae5 req-668e62fc-0593-43fd-adff-b5133e62a52b service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064352 Jul 18 10:30:00.275991 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 75/157] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jul 18 10:30:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:30:00.311941 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-e1b4c450-2676-41f3-b834-3ca08ab9835e tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:30:00.313114 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-e1b4c450-2676-41f3-b834-3ca08ab9835e tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] [instance: 150a6155-aec7-449b-88f4-aab89d373ddc] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:30:00.331484 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-e1b4c450-2676-41f3-b834-3ca08ab9835e tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:30:00.332401 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-e1b4c450-2676-41f3-b834-3ca08ab9835e tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:30:00.333381 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-e1b4c450-2676-41f3-b834-3ca08ab9835e tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:30:00.334189 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-e1b4c450-2676-41f3-b834-3ca08ab9835e tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:30:00.547817 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-ad7ba49f-8282-4992-a79b-2f5647dc67de tempest-DeleteServersTestJSON-1052419078 tempest-DeleteServersTestJSON-1052419078-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:30:00.549460 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-ad7ba49f-8282-4992-a79b-2f5647dc67de tempest-DeleteServersTestJSON-1052419078 tempest-DeleteServersTestJSON-1052419078-project] [instance: df938010-ebc5-429f-8499-4b55eff7cab9] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:30:00.556424 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-ad7ba49f-8282-4992-a79b-2f5647dc67de tempest-DeleteServersTestJSON-1052419078 tempest-DeleteServersTestJSON-1052419078-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:30:00.557110 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-ad7ba49f-8282-4992-a79b-2f5647dc67de tempest-DeleteServersTestJSON-1052419078 tempest-DeleteServersTestJSON-1052419078-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:30:00.558168 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-ad7ba49f-8282-4992-a79b-2f5647dc67de tempest-DeleteServersTestJSON-1052419078 tempest-DeleteServersTestJSON-1052419078-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:30:00.558784 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-ad7ba49f-8282-4992-a79b-2f5647dc67de tempest-DeleteServersTestJSON-1052419078 tempest-DeleteServersTestJSON-1052419078-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:30:00.767539 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-ad7ba49f-8282-4992-a79b-2f5647dc67de tempest-DeleteServersTestJSON-1052419078 tempest-DeleteServersTestJSON-1052419078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0f993e44c624f65abae22540ce7dffc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daab623e57e54081b262d4a8fe124f42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:30:00.780726 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-ad7ba49f-8282-4992-a79b-2f5647dc67de tempest-DeleteServersTestJSON-1052419078 tempest-DeleteServersTestJSON-1052419078-project] 10.222.0.33 "GET /compute/v2.1/servers/df938010-ebc5-429f-8499-4b55eff7cab9" status: 200 len: 1346 microversion: 2.1 time: 0.237372 Jul 18 10:30:00.781978 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 76/158] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:30:00 2022] GET /compute/v2.1/servers/df938010-ebc5-429f-8499-4b55eff7cab9 => generated 1346 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:30:00.839103 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-e1b4c450-2676-41f3-b834-3ca08ab9835e tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc233897770f47e5bd40fb03afabe49c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9698a0142f494095a93a4e804437bc32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:30:00.847767 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-e1b4c450-2676-41f3-b834-3ca08ab9835e tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] 10.222.0.33 "GET /compute/v2.1/servers/150a6155-aec7-449b-88f4-aab89d373ddc" status: 200 len: 1314 microversion: 2.1 time: 0.539728 Jul 18 10:30:00.848451 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 83/159] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:30:00 2022] GET /compute/v2.1/servers/150a6155-aec7-449b-88f4-aab89d373ddc => generated 1314 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:30:00.903874 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-30930134-259a-4a6d-801a-98c38e03754e tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:30:00.904488 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-30930134-259a-4a6d-801a-98c38e03754e tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] [instance: 78bb7f95-9846-4a59-9f77-a3fe69005eec] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:30:00.911142 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-30930134-259a-4a6d-801a-98c38e03754e tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:30:00.911741 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-30930134-259a-4a6d-801a-98c38e03754e tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:30:00.912613 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-30930134-259a-4a6d-801a-98c38e03754e tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:30:00.913346 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-30930134-259a-4a6d-801a-98c38e03754e tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:30:01.181907 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-30930134-259a-4a6d-801a-98c38e03754e tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a431c9708f4694bc0d514133e76088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a1921237622439bab89676e11477c13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:30:01.193938 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-30930134-259a-4a6d-801a-98c38e03754e tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] 10.222.0.33 "GET /compute/v2.1/servers/78bb7f95-9846-4a59-9f77-a3fe69005eec" status: 200 len: 1520 microversion: 2.1 time: 0.294121 Jul 18 10:30:01.200671 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 77/160] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:30:00 2022] GET /compute/v2.1/servers/78bb7f95-9846-4a59-9f77-a3fe69005eec => generated 1520 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:30:01.803109 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-69ef74dd-a133-4cf1-9f44-0a5e38dd9068 tempest-DeleteServersTestJSON-1052419078 tempest-DeleteServersTestJSON-1052419078-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:30:01.804539 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-69ef74dd-a133-4cf1-9f44-0a5e38dd9068 tempest-DeleteServersTestJSON-1052419078 tempest-DeleteServersTestJSON-1052419078-project] [instance: df938010-ebc5-429f-8499-4b55eff7cab9] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:30:01.814006 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-69ef74dd-a133-4cf1-9f44-0a5e38dd9068 tempest-DeleteServersTestJSON-1052419078 tempest-DeleteServersTestJSON-1052419078-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:30:01.814912 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-69ef74dd-a133-4cf1-9f44-0a5e38dd9068 tempest-DeleteServersTestJSON-1052419078 tempest-DeleteServersTestJSON-1052419078-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:30:01.817221 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-69ef74dd-a133-4cf1-9f44-0a5e38dd9068 tempest-DeleteServersTestJSON-1052419078 tempest-DeleteServersTestJSON-1052419078-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:30:01.818425 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-69ef74dd-a133-4cf1-9f44-0a5e38dd9068 tempest-DeleteServersTestJSON-1052419078 tempest-DeleteServersTestJSON-1052419078-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:30:01.842673 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.wsgi [None req-69ef74dd-a133-4cf1-9f44-0a5e38dd9068 tempest-DeleteServersTestJSON-1052419078 tempest-DeleteServersTestJSON-1052419078-project] HTTP exception thrown: Instance df938010-ebc5-429f-8499-4b55eff7cab9 could not be found. Jul 18 10:30:01.853198 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-69ef74dd-a133-4cf1-9f44-0a5e38dd9068 tempest-DeleteServersTestJSON-1052419078 tempest-DeleteServersTestJSON-1052419078-project] Request method failure captured: Jul 18 10:30:01.853198 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: request: GET /compute/v2.1/servers/df938010-ebc5-429f-8499-4b55eff7cab9 HTTP/1.1 Jul 18 10:30:01.853198 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: Accept: application/json Jul 18 10:30:01.853198 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: Accept-Encoding: identity Jul 18 10:30:01.853198 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: Connection: close Jul 18 10:30:01.853198 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: Content-Length: 0 Jul 18 10:30:01.853198 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: Content-Type: application/json Jul 18 10:30:01.853198 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: Host: 10.222.0.33 Jul 18 10:30:01.853198 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: Openstack-System-Scope: None Jul 18 10:30:01.853198 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: User-Agent: python-urllib3/1.26.9 Jul 18 10:30:01.853198 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Auth-Token: gAAAAABi1TX1axwaxrKAE0q6P4eNcMKYl_-9qu6Ri62oE35ljHyqdEIkhQcgKCgHfnQMiv92ZVzDShkCkcfuud7-r1RUuNYLgpJvH3nb2eE_7CgYN_P5etlBJcEehXOMx2tqSeK9HWsg5uoQnwK2mbRuOG3-IydC7YvHuoFn8j7DfVz3Ms55dJ0 Jul 18 10:30:01.853198 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Domain-Id: None Jul 18 10:30:01.853198 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Domain-Name: None Jul 18 10:30:01.853198 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Identity-Status: Confirmed Jul 18 10:30:01.853198 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Is-Admin-Project: True Jul 18 10:30:01.853198 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Project-Domain-Id: default Jul 18 10:30:01.853198 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Project-Domain-Name: Default Jul 18 10:30:01.853198 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Project-Id: daab623e57e54081b262d4a8fe124f42 Jul 18 10:30:01.853198 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Project-Name: tempest-DeleteServersTestJSON-1052419078 Jul 18 10:30:01.853198 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Role: member,reader Jul 18 10:30:01.853198 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Roles: member,reader Jul 18 10:30:01.855113 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/daab623e57e54081b262d4a8fe124f42"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/daab623e57e54081b262d4a8fe124f42"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/daab623e57e54081b262d4a8fe124f42"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_daab623e57e54081b262d4a8fe124f42"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jul 18 10:30:01.855113 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Tenant: tempest-DeleteServersTestJSON-1052419078 Jul 18 10:30:01.855113 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Tenant-Id: daab623e57e54081b262d4a8fe124f42 Jul 18 10:30:01.855113 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Tenant-Name: tempest-DeleteServersTestJSON-1052419078 Jul 18 10:30:01.855113 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-User: tempest-DeleteServersTestJSON-1052419078-project Jul 18 10:30:01.855113 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-User-Domain-Id: default Jul 18 10:30:01.855113 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-User-Domain-Name: Default Jul 18 10:30:01.855113 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-User-Id: c0f993e44c624f65abae22540ce7dffc Jul 18 10:30:01.855113 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-User-Name: tempest-DeleteServersTestJSON-1052419078-project Jul 18 10:30:01.855113 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: method: > Jul 18 10:30:01.855113 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: exception: Instance df938010-ebc5-429f-8499-4b55eff7cab9 could not be found. Jul 18 10:30:01.855113 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: action_args: {'id': 'df938010-ebc5-429f-8499-4b55eff7cab9'} Jul 18 10:30:01.855933 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 10:30:01.855933 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:30:01.855933 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 10:30:01.855933 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 10:30:01.855933 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 10:30:01.855933 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 10:30:01.855933 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 10:30:01.855933 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 10:30:01.855933 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 10:30:01.855933 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 10:30:01.855933 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance df938010-ebc5-429f-8499-4b55eff7cab9 could not be found. Jul 18 10:30:01.855933 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi Jul 18 10:30:01.855933 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:30:01.855933 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi Jul 18 10:30:01.855933 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:30:01.855933 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:30:01.855933 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:30:01.855933 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 10:30:01.855933 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 10:30:01.855933 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 10:30:01.858510 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 10:30:01.858510 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 10:30:01.858510 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 10:30:01.858510 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 10:30:01.858510 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 10:30:01.858510 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 10:30:01.858510 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 10:30:01.858510 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance df938010-ebc5-429f-8499-4b55eff7cab9 could not be found. Jul 18 10:30:01.858510 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi Jul 18 10:30:01.858510 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:30:01.858510 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi Jul 18 10:30:01.858510 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:30:01.858510 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:30:01.858510 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:30:01.858510 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 10:30:01.858510 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 10:30:01.858510 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance df938010-ebc5-429f-8499-4b55eff7cab9 could not be found. Jul 18 10:30:01.858510 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi Jul 18 10:30:01.869455 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-5929be5e-7331-4d57-ab07-e39c21c9e334 tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:30:01.871491 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-5929be5e-7331-4d57-ab07-e39c21c9e334 tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] [instance: 150a6155-aec7-449b-88f4-aab89d373ddc] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:30:01.875460 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG dbcounter [-] [117880] Writing DB stats nova_api:SELECT=74 {{(pid=117880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:30:01.878161 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-69ef74dd-a133-4cf1-9f44-0a5e38dd9068 tempest-DeleteServersTestJSON-1052419078 tempest-DeleteServersTestJSON-1052419078-project] Returning 404 to user: Instance df938010-ebc5-429f-8499-4b55eff7cab9 could not be found. {{(pid=117879) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 10:30:01.879474 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-69ef74dd-a133-4cf1-9f44-0a5e38dd9068 tempest-DeleteServersTestJSON-1052419078 tempest-DeleteServersTestJSON-1052419078-project] 10.222.0.33 "GET /compute/v2.1/servers/df938010-ebc5-429f-8499-4b55eff7cab9" status: 404 len: 111 microversion: 2.1 time: 0.085619 Jul 18 10:30:01.881669 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 84/161] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:30:01 2022] GET /compute/v2.1/servers/df938010-ebc5-429f-8499-4b55eff7cab9 => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 10:30:01.885098 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-5929be5e-7331-4d57-ab07-e39c21c9e334 tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:30:01.885592 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-5929be5e-7331-4d57-ab07-e39c21c9e334 tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:30:01.886582 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-5929be5e-7331-4d57-ab07-e39c21c9e334 tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:30:01.887017 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-5929be5e-7331-4d57-ab07-e39c21c9e334 tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:30:02.017695 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-ca348cae-6295-4f98-8687-c15f1d6cbb1b tempest-DeleteServersTestJSON-1052419078 tempest-DeleteServersTestJSON-1052419078-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:30:02.018765 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-ca348cae-6295-4f98-8687-c15f1d6cbb1b tempest-DeleteServersTestJSON-1052419078 tempest-DeleteServersTestJSON-1052419078-project] [instance: df938010-ebc5-429f-8499-4b55eff7cab9] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:30:02.024822 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-ca348cae-6295-4f98-8687-c15f1d6cbb1b tempest-DeleteServersTestJSON-1052419078 tempest-DeleteServersTestJSON-1052419078-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:30:02.025342 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-ca348cae-6295-4f98-8687-c15f1d6cbb1b tempest-DeleteServersTestJSON-1052419078 tempest-DeleteServersTestJSON-1052419078-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:30:02.026095 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-ca348cae-6295-4f98-8687-c15f1d6cbb1b tempest-DeleteServersTestJSON-1052419078 tempest-DeleteServersTestJSON-1052419078-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:30:02.026526 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-ca348cae-6295-4f98-8687-c15f1d6cbb1b tempest-DeleteServersTestJSON-1052419078 tempest-DeleteServersTestJSON-1052419078-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:30:02.039696 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.wsgi [None req-ca348cae-6295-4f98-8687-c15f1d6cbb1b tempest-DeleteServersTestJSON-1052419078 tempest-DeleteServersTestJSON-1052419078-project] HTTP exception thrown: Instance df938010-ebc5-429f-8499-4b55eff7cab9 could not be found. Jul 18 10:30:02.041520 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-ca348cae-6295-4f98-8687-c15f1d6cbb1b tempest-DeleteServersTestJSON-1052419078 tempest-DeleteServersTestJSON-1052419078-project] Request method failure captured: Jul 18 10:30:02.041520 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: request: GET /compute/v2.1/servers/df938010-ebc5-429f-8499-4b55eff7cab9/os-volume_attachments HTTP/1.1 Jul 18 10:30:02.041520 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: Accept: application/json Jul 18 10:30:02.041520 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: Accept-Encoding: identity Jul 18 10:30:02.041520 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: Connection: close Jul 18 10:30:02.041520 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: Content-Length: 0 Jul 18 10:30:02.041520 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: Content-Type: application/json Jul 18 10:30:02.041520 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: Host: 10.222.0.33 Jul 18 10:30:02.041520 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: Openstack-System-Scope: None Jul 18 10:30:02.041520 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: User-Agent: python-urllib3/1.26.9 Jul 18 10:30:02.041520 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Auth-Token: gAAAAABi1TX1axwaxrKAE0q6P4eNcMKYl_-9qu6Ri62oE35ljHyqdEIkhQcgKCgHfnQMiv92ZVzDShkCkcfuud7-r1RUuNYLgpJvH3nb2eE_7CgYN_P5etlBJcEehXOMx2tqSeK9HWsg5uoQnwK2mbRuOG3-IydC7YvHuoFn8j7DfVz3Ms55dJ0 Jul 18 10:30:02.041520 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Domain-Id: None Jul 18 10:30:02.041520 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Domain-Name: None Jul 18 10:30:02.041520 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Identity-Status: Confirmed Jul 18 10:30:02.041520 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Is-Admin-Project: True Jul 18 10:30:02.041520 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Project-Domain-Id: default Jul 18 10:30:02.041520 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Project-Domain-Name: Default Jul 18 10:30:02.041520 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Project-Id: daab623e57e54081b262d4a8fe124f42 Jul 18 10:30:02.041520 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Project-Name: tempest-DeleteServersTestJSON-1052419078 Jul 18 10:30:02.041520 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Role: member,reader Jul 18 10:30:02.041520 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Roles: member,reader Jul 18 10:30:02.042940 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/daab623e57e54081b262d4a8fe124f42"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/daab623e57e54081b262d4a8fe124f42"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/daab623e57e54081b262d4a8fe124f42"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_daab623e57e54081b262d4a8fe124f42"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jul 18 10:30:02.042940 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Tenant: tempest-DeleteServersTestJSON-1052419078 Jul 18 10:30:02.042940 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Tenant-Id: daab623e57e54081b262d4a8fe124f42 Jul 18 10:30:02.042940 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Tenant-Name: tempest-DeleteServersTestJSON-1052419078 Jul 18 10:30:02.042940 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-User: tempest-DeleteServersTestJSON-1052419078-project Jul 18 10:30:02.042940 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-User-Domain-Id: default Jul 18 10:30:02.042940 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-User-Domain-Name: Default Jul 18 10:30:02.042940 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-User-Id: c0f993e44c624f65abae22540ce7dffc Jul 18 10:30:02.042940 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-User-Name: tempest-DeleteServersTestJSON-1052419078-project Jul 18 10:30:02.042940 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: method: > Jul 18 10:30:02.042940 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: exception: Instance df938010-ebc5-429f-8499-4b55eff7cab9 could not be found. Jul 18 10:30:02.042940 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: action_args: {'server_id': 'df938010-ebc5-429f-8499-4b55eff7cab9'} Jul 18 10:30:02.044932 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 10:30:02.044932 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:30:02.044932 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 10:30:02.044932 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 10:30:02.044932 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 10:30:02.044932 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 10:30:02.044932 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 10:30:02.044932 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 10:30:02.044932 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 10:30:02.044932 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 10:30:02.044932 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance df938010-ebc5-429f-8499-4b55eff7cab9 could not be found. Jul 18 10:30:02.044932 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi Jul 18 10:30:02.044932 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:30:02.044932 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi Jul 18 10:30:02.044932 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:30:02.044932 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:30:02.044932 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:30:02.044932 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 10:30:02.044932 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 10:30:02.044932 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 10:30:02.045965 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 10:30:02.045965 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 18 10:30:02.045965 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 10:30:02.045965 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 18 10:30:02.045965 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 10:30:02.045965 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jul 18 10:30:02.045965 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jul 18 10:30:02.045965 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 10:30:02.045965 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 10:30:02.045965 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance df938010-ebc5-429f-8499-4b55eff7cab9 could not be found. Jul 18 10:30:02.045965 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi Jul 18 10:30:02.045965 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:30:02.045965 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi Jul 18 10:30:02.045965 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:30:02.045965 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:30:02.045965 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:30:02.045965 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 10:30:02.045965 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 10:30:02.045965 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance df938010-ebc5-429f-8499-4b55eff7cab9 could not be found. Jul 18 10:30:02.045965 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi Jul 18 10:30:02.047161 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-ca348cae-6295-4f98-8687-c15f1d6cbb1b tempest-DeleteServersTestJSON-1052419078 tempest-DeleteServersTestJSON-1052419078-project] Returning 404 to user: Instance df938010-ebc5-429f-8499-4b55eff7cab9 could not be found. {{(pid=117879) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 10:30:02.047161 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-ca348cae-6295-4f98-8687-c15f1d6cbb1b tempest-DeleteServersTestJSON-1052419078 tempest-DeleteServersTestJSON-1052419078-project] 10.222.0.33 "GET /compute/v2.1/servers/df938010-ebc5-429f-8499-4b55eff7cab9/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.029225 Jul 18 10:30:02.047161 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 85/162] 10.222.0.33 () {58 vars in 1301 bytes} [Mon Jul 18 10:30:02 2022] GET /compute/v2.1/servers/df938010-ebc5-429f-8499-4b55eff7cab9/os-volume_attachments => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 18 10:30:02.077362 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-5929be5e-7331-4d57-ab07-e39c21c9e334 tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc233897770f47e5bd40fb03afabe49c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9698a0142f494095a93a4e804437bc32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:30:02.085614 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-5929be5e-7331-4d57-ab07-e39c21c9e334 tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] 10.222.0.33 "GET /compute/v2.1/servers/150a6155-aec7-449b-88f4-aab89d373ddc" status: 200 len: 1314 microversion: 2.1 time: 0.223631 Jul 18 10:30:02.086181 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 78/163] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:30:01 2022] GET /compute/v2.1/servers/150a6155-aec7-449b-88f4-aab89d373ddc => generated 1314 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:30:02.211701 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-88a04595-c08e-4cf2-979a-d7947dd24ad4 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:30:02.212308 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-88a04595-c08e-4cf2-979a-d7947dd24ad4 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] [instance: 78bb7f95-9846-4a59-9f77-a3fe69005eec] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:30:02.219251 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-88a04595-c08e-4cf2-979a-d7947dd24ad4 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:30:02.219689 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-88a04595-c08e-4cf2-979a-d7947dd24ad4 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:30:02.220624 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-88a04595-c08e-4cf2-979a-d7947dd24ad4 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:30:02.221090 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-88a04595-c08e-4cf2-979a-d7947dd24ad4 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:30:02.297715 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [req-d94c381f-211f-4f1f-b168-eec430251c6b req-cf7b0008-ed31-4977-8d22-9999003f295e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "150a6155-aec7-449b-88f4-aab89d373ddc", "tag": "50378def-8454-4be1-888b-dcffb98de187"}]} {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:30:02.306399 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [req-d94c381f-211f-4f1f-b168-eec430251c6b req-cf7b0008-ed31-4977-8d22-9999003f295e service nova] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:30:02.306842 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [req-d94c381f-211f-4f1f-b168-eec430251c6b req-cf7b0008-ed31-4977-8d22-9999003f295e service nova] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:30:02.319212 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.compute.server_external_events [req-d94c381f-211f-4f1f-b168-eec430251c6b req-cf7b0008-ed31-4977-8d22-9999003f295e service nova] Creating event network-changed:50378def-8454-4be1-888b-dcffb98de187 for instance 150a6155-aec7-449b-88f4-aab89d373ddc on hv-cinder-83754 Jul 18 10:30:02.329637 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [req-d94c381f-211f-4f1f-b168-eec430251c6b req-cf7b0008-ed31-4977-8d22-9999003f295e service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035865 Jul 18 10:30:02.330231 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 79/164] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jul 18 10:30:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:30:02.380972 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-88a04595-c08e-4cf2-979a-d7947dd24ad4 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a431c9708f4694bc0d514133e76088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a1921237622439bab89676e11477c13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:30:02.389082 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-88a04595-c08e-4cf2-979a-d7947dd24ad4 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] 10.222.0.33 "GET /compute/v2.1/servers/78bb7f95-9846-4a59-9f77-a3fe69005eec" status: 200 len: 1520 microversion: 2.1 time: 0.181241 Jul 18 10:30:02.389865 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 86/165] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:30:02 2022] GET /compute/v2.1/servers/78bb7f95-9846-4a59-9f77-a3fe69005eec => generated 1520 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:30:03.102395 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-80f1a8fa-008c-4ad5-8315-55b39deabf0c tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:30:03.103082 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-80f1a8fa-008c-4ad5-8315-55b39deabf0c tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] [instance: 150a6155-aec7-449b-88f4-aab89d373ddc] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:30:03.110395 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-80f1a8fa-008c-4ad5-8315-55b39deabf0c tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:30:03.111090 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-80f1a8fa-008c-4ad5-8315-55b39deabf0c tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:30:03.111860 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-80f1a8fa-008c-4ad5-8315-55b39deabf0c tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:30:03.113072 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-80f1a8fa-008c-4ad5-8315-55b39deabf0c tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:30:03.288644 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-3bd195a0-1464-42eb-ba77-368feebd8d5b tempest-DeleteServersTestJSON-1052419078 tempest-DeleteServersTestJSON-1052419078-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:30:03.289843 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-3bd195a0-1464-42eb-ba77-368feebd8d5b tempest-DeleteServersTestJSON-1052419078 tempest-DeleteServersTestJSON-1052419078-project] [instance: df938010-ebc5-429f-8499-4b55eff7cab9] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:30:03.296663 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-3bd195a0-1464-42eb-ba77-368feebd8d5b tempest-DeleteServersTestJSON-1052419078 tempest-DeleteServersTestJSON-1052419078-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:30:03.297147 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-3bd195a0-1464-42eb-ba77-368feebd8d5b tempest-DeleteServersTestJSON-1052419078 tempest-DeleteServersTestJSON-1052419078-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:30:03.297960 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-3bd195a0-1464-42eb-ba77-368feebd8d5b tempest-DeleteServersTestJSON-1052419078 tempest-DeleteServersTestJSON-1052419078-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:30:03.298379 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-3bd195a0-1464-42eb-ba77-368feebd8d5b tempest-DeleteServersTestJSON-1052419078 tempest-DeleteServersTestJSON-1052419078-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:30:03.313749 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.wsgi [None req-3bd195a0-1464-42eb-ba77-368feebd8d5b tempest-DeleteServersTestJSON-1052419078 tempest-DeleteServersTestJSON-1052419078-project] HTTP exception thrown: Instance df938010-ebc5-429f-8499-4b55eff7cab9 could not be found. Jul 18 10:30:03.316185 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-3bd195a0-1464-42eb-ba77-368feebd8d5b tempest-DeleteServersTestJSON-1052419078 tempest-DeleteServersTestJSON-1052419078-project] Request method failure captured: Jul 18 10:30:03.316185 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: request: DELETE /compute/v2.1/servers/df938010-ebc5-429f-8499-4b55eff7cab9 HTTP/1.1 Jul 18 10:30:03.316185 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: Accept: application/json Jul 18 10:30:03.316185 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: Accept-Encoding: identity Jul 18 10:30:03.316185 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: Connection: close Jul 18 10:30:03.316185 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: Content-Length: 0 Jul 18 10:30:03.316185 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: Content-Type: application/json Jul 18 10:30:03.316185 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: Host: 10.222.0.33 Jul 18 10:30:03.316185 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: Openstack-System-Scope: None Jul 18 10:30:03.316185 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: User-Agent: python-urllib3/1.26.9 Jul 18 10:30:03.316185 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Auth-Token: gAAAAABi1TX1axwaxrKAE0q6P4eNcMKYl_-9qu6Ri62oE35ljHyqdEIkhQcgKCgHfnQMiv92ZVzDShkCkcfuud7-r1RUuNYLgpJvH3nb2eE_7CgYN_P5etlBJcEehXOMx2tqSeK9HWsg5uoQnwK2mbRuOG3-IydC7YvHuoFn8j7DfVz3Ms55dJ0 Jul 18 10:30:03.316185 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Domain-Id: None Jul 18 10:30:03.316185 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Domain-Name: None Jul 18 10:30:03.316185 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Identity-Status: Confirmed Jul 18 10:30:03.316185 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Is-Admin-Project: True Jul 18 10:30:03.316185 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Project-Domain-Id: default Jul 18 10:30:03.316185 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Project-Domain-Name: Default Jul 18 10:30:03.316185 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Project-Id: daab623e57e54081b262d4a8fe124f42 Jul 18 10:30:03.316185 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Project-Name: tempest-DeleteServersTestJSON-1052419078 Jul 18 10:30:03.316185 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Role: member,reader Jul 18 10:30:03.316185 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Roles: member,reader Jul 18 10:30:03.317465 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/daab623e57e54081b262d4a8fe124f42"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/daab623e57e54081b262d4a8fe124f42"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/daab623e57e54081b262d4a8fe124f42"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_daab623e57e54081b262d4a8fe124f42"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jul 18 10:30:03.317465 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Tenant: tempest-DeleteServersTestJSON-1052419078 Jul 18 10:30:03.317465 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Tenant-Id: daab623e57e54081b262d4a8fe124f42 Jul 18 10:30:03.317465 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Tenant-Name: tempest-DeleteServersTestJSON-1052419078 Jul 18 10:30:03.317465 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-User: tempest-DeleteServersTestJSON-1052419078-project Jul 18 10:30:03.317465 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-User-Domain-Id: default Jul 18 10:30:03.317465 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-User-Domain-Name: Default Jul 18 10:30:03.317465 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-User-Id: c0f993e44c624f65abae22540ce7dffc Jul 18 10:30:03.317465 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-User-Name: tempest-DeleteServersTestJSON-1052419078-project Jul 18 10:30:03.317465 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: method: > Jul 18 10:30:03.317465 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: exception: Instance df938010-ebc5-429f-8499-4b55eff7cab9 could not be found. Jul 18 10:30:03.317465 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: action_args: {'id': 'df938010-ebc5-429f-8499-4b55eff7cab9'} Jul 18 10:30:03.318198 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 10:30:03.318198 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:30:03.318198 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 10:30:03.318198 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 10:30:03.318198 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 10:30:03.318198 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 10:30:03.318198 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 10:30:03.318198 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 10:30:03.318198 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 10:30:03.318198 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 10:30:03.318198 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance df938010-ebc5-429f-8499-4b55eff7cab9 could not be found. Jul 18 10:30:03.318198 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi Jul 18 10:30:03.318198 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:30:03.318198 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi Jul 18 10:30:03.318198 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:30:03.318198 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:30:03.318198 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:30:03.318198 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 10:30:03.318198 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 10:30:03.318198 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 10:30:03.319306 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 10:30:03.319306 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 18 10:30:03.319306 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 18 10:30:03.319306 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 18 10:30:03.319306 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 18 10:30:03.319306 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 10:30:03.319306 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 10:30:03.319306 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 10:30:03.319306 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 10:30:03.319306 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance df938010-ebc5-429f-8499-4b55eff7cab9 could not be found. Jul 18 10:30:03.319306 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi Jul 18 10:30:03.319306 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:30:03.319306 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi Jul 18 10:30:03.319306 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:30:03.319306 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:30:03.319306 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:30:03.319306 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 10:30:03.319306 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 10:30:03.319306 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance df938010-ebc5-429f-8499-4b55eff7cab9 could not be found. Jul 18 10:30:03.319306 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi Jul 18 10:30:03.322715 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-3bd195a0-1464-42eb-ba77-368feebd8d5b tempest-DeleteServersTestJSON-1052419078 tempest-DeleteServersTestJSON-1052419078-project] Returning 404 to user: Instance df938010-ebc5-429f-8499-4b55eff7cab9 could not be found. {{(pid=117879) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 10:30:03.323679 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-3bd195a0-1464-42eb-ba77-368feebd8d5b tempest-DeleteServersTestJSON-1052419078 tempest-DeleteServersTestJSON-1052419078-project] 10.222.0.33 "DELETE /compute/v2.1/servers/df938010-ebc5-429f-8499-4b55eff7cab9" status: 404 len: 111 microversion: 2.1 time: 0.039622 Jul 18 10:30:03.324480 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 87/166] 10.222.0.33 () {58 vars in 1238 bytes} [Mon Jul 18 10:30:03 2022] DELETE /compute/v2.1/servers/df938010-ebc5-429f-8499-4b55eff7cab9 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 18 10:30:03.334600 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-f2880b82-8736-4194-b8f0-3bb894b4f303 tempest-DeleteServersTestJSON-1052419078 tempest-DeleteServersTestJSON-1052419078-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:30:03.335640 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-f2880b82-8736-4194-b8f0-3bb894b4f303 tempest-DeleteServersTestJSON-1052419078 tempest-DeleteServersTestJSON-1052419078-project] [instance: df938010-ebc5-429f-8499-4b55eff7cab9] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:30:03.347141 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-f2880b82-8736-4194-b8f0-3bb894b4f303 tempest-DeleteServersTestJSON-1052419078 tempest-DeleteServersTestJSON-1052419078-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:30:03.348333 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-f2880b82-8736-4194-b8f0-3bb894b4f303 tempest-DeleteServersTestJSON-1052419078 tempest-DeleteServersTestJSON-1052419078-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:30:03.350851 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-f2880b82-8736-4194-b8f0-3bb894b4f303 tempest-DeleteServersTestJSON-1052419078 tempest-DeleteServersTestJSON-1052419078-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:30:03.351848 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-f2880b82-8736-4194-b8f0-3bb894b4f303 tempest-DeleteServersTestJSON-1052419078 tempest-DeleteServersTestJSON-1052419078-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:30:03.379617 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.wsgi [None req-f2880b82-8736-4194-b8f0-3bb894b4f303 tempest-DeleteServersTestJSON-1052419078 tempest-DeleteServersTestJSON-1052419078-project] HTTP exception thrown: Instance df938010-ebc5-429f-8499-4b55eff7cab9 could not be found. Jul 18 10:30:03.381186 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-f2880b82-8736-4194-b8f0-3bb894b4f303 tempest-DeleteServersTestJSON-1052419078 tempest-DeleteServersTestJSON-1052419078-project] Request method failure captured: Jul 18 10:30:03.381186 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: request: GET /compute/v2.1/servers/df938010-ebc5-429f-8499-4b55eff7cab9 HTTP/1.1 Jul 18 10:30:03.381186 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: Accept: application/json Jul 18 10:30:03.381186 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: Accept-Encoding: identity Jul 18 10:30:03.381186 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: Connection: close Jul 18 10:30:03.381186 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: Content-Length: 0 Jul 18 10:30:03.381186 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: Content-Type: application/json Jul 18 10:30:03.381186 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: Host: 10.222.0.33 Jul 18 10:30:03.381186 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: Openstack-System-Scope: None Jul 18 10:30:03.381186 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: User-Agent: python-urllib3/1.26.9 Jul 18 10:30:03.381186 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Auth-Token: gAAAAABi1TX1axwaxrKAE0q6P4eNcMKYl_-9qu6Ri62oE35ljHyqdEIkhQcgKCgHfnQMiv92ZVzDShkCkcfuud7-r1RUuNYLgpJvH3nb2eE_7CgYN_P5etlBJcEehXOMx2tqSeK9HWsg5uoQnwK2mbRuOG3-IydC7YvHuoFn8j7DfVz3Ms55dJ0 Jul 18 10:30:03.381186 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Domain-Id: None Jul 18 10:30:03.381186 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Domain-Name: None Jul 18 10:30:03.381186 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Identity-Status: Confirmed Jul 18 10:30:03.381186 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Is-Admin-Project: True Jul 18 10:30:03.381186 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Project-Domain-Id: default Jul 18 10:30:03.381186 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Project-Domain-Name: Default Jul 18 10:30:03.381186 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Project-Id: daab623e57e54081b262d4a8fe124f42 Jul 18 10:30:03.381186 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Project-Name: tempest-DeleteServersTestJSON-1052419078 Jul 18 10:30:03.381186 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Role: member,reader Jul 18 10:30:03.381186 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Roles: member,reader Jul 18 10:30:03.382702 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/daab623e57e54081b262d4a8fe124f42"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/daab623e57e54081b262d4a8fe124f42"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/daab623e57e54081b262d4a8fe124f42"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_daab623e57e54081b262d4a8fe124f42"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jul 18 10:30:03.382702 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Tenant: tempest-DeleteServersTestJSON-1052419078 Jul 18 10:30:03.382702 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Tenant-Id: daab623e57e54081b262d4a8fe124f42 Jul 18 10:30:03.382702 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Tenant-Name: tempest-DeleteServersTestJSON-1052419078 Jul 18 10:30:03.382702 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-User: tempest-DeleteServersTestJSON-1052419078-project Jul 18 10:30:03.382702 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-User-Domain-Id: default Jul 18 10:30:03.382702 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-User-Domain-Name: Default Jul 18 10:30:03.382702 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-User-Id: c0f993e44c624f65abae22540ce7dffc Jul 18 10:30:03.382702 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-User-Name: tempest-DeleteServersTestJSON-1052419078-project Jul 18 10:30:03.382702 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: method: > Jul 18 10:30:03.382702 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: exception: Instance df938010-ebc5-429f-8499-4b55eff7cab9 could not be found. Jul 18 10:30:03.382702 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: action_args: {'id': 'df938010-ebc5-429f-8499-4b55eff7cab9'} Jul 18 10:30:03.386908 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 10:30:03.386908 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:30:03.386908 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 10:30:03.386908 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 10:30:03.386908 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 10:30:03.386908 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 10:30:03.386908 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 10:30:03.386908 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 10:30:03.386908 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 10:30:03.386908 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 10:30:03.386908 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance df938010-ebc5-429f-8499-4b55eff7cab9 could not be found. Jul 18 10:30:03.386908 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi Jul 18 10:30:03.386908 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:30:03.386908 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi Jul 18 10:30:03.386908 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:30:03.386908 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:30:03.386908 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:30:03.386908 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 10:30:03.386908 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 10:30:03.386908 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 10:30:03.388765 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 10:30:03.388765 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 10:30:03.388765 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 10:30:03.388765 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 10:30:03.388765 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 10:30:03.388765 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 10:30:03.388765 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 10:30:03.388765 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance df938010-ebc5-429f-8499-4b55eff7cab9 could not be found. Jul 18 10:30:03.388765 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi Jul 18 10:30:03.388765 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:30:03.388765 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi Jul 18 10:30:03.388765 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:30:03.388765 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:30:03.388765 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:30:03.388765 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 10:30:03.388765 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 10:30:03.388765 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance df938010-ebc5-429f-8499-4b55eff7cab9 could not be found. Jul 18 10:30:03.388765 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi Jul 18 10:30:03.389986 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-f2880b82-8736-4194-b8f0-3bb894b4f303 tempest-DeleteServersTestJSON-1052419078 tempest-DeleteServersTestJSON-1052419078-project] Returning 404 to user: Instance df938010-ebc5-429f-8499-4b55eff7cab9 could not be found. {{(pid=117879) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 10:30:03.389986 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-f2880b82-8736-4194-b8f0-3bb894b4f303 tempest-DeleteServersTestJSON-1052419078 tempest-DeleteServersTestJSON-1052419078-project] 10.222.0.33 "GET /compute/v2.1/servers/df938010-ebc5-429f-8499-4b55eff7cab9" status: 404 len: 111 microversion: 2.1 time: 0.053977 Jul 18 10:30:03.389986 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 88/167] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:30:03 2022] GET /compute/v2.1/servers/df938010-ebc5-429f-8499-4b55eff7cab9 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 18 10:30:03.407668 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-b44c7ecf-e21e-4bc5-a554-80514f4a067c tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:30:03.408275 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-b44c7ecf-e21e-4bc5-a554-80514f4a067c tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] [instance: 78bb7f95-9846-4a59-9f77-a3fe69005eec] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:30:03.415253 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-b44c7ecf-e21e-4bc5-a554-80514f4a067c tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:30:03.415777 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-b44c7ecf-e21e-4bc5-a554-80514f4a067c tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:30:03.416640 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-b44c7ecf-e21e-4bc5-a554-80514f4a067c tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:30:03.417081 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-b44c7ecf-e21e-4bc5-a554-80514f4a067c tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:30:03.439850 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-80f1a8fa-008c-4ad5-8315-55b39deabf0c tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc233897770f47e5bd40fb03afabe49c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9698a0142f494095a93a4e804437bc32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:30:03.454340 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-80f1a8fa-008c-4ad5-8315-55b39deabf0c tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] 10.222.0.33 "GET /compute/v2.1/servers/150a6155-aec7-449b-88f4-aab89d373ddc" status: 200 len: 1314 microversion: 2.1 time: 0.355981 Jul 18 10:30:03.465728 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 80/168] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:30:03 2022] GET /compute/v2.1/servers/150a6155-aec7-449b-88f4-aab89d373ddc => generated 1314 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:30:03.756306 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-b44c7ecf-e21e-4bc5-a554-80514f4a067c tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a431c9708f4694bc0d514133e76088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a1921237622439bab89676e11477c13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:30:03.768672 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-b44c7ecf-e21e-4bc5-a554-80514f4a067c tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] 10.222.0.33 "GET /compute/v2.1/servers/78bb7f95-9846-4a59-9f77-a3fe69005eec" status: 200 len: 1520 microversion: 2.1 time: 0.365400 Jul 18 10:30:03.769955 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 89/169] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:30:03 2022] GET /compute/v2.1/servers/78bb7f95-9846-4a59-9f77-a3fe69005eec => generated 1520 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:30:04.473886 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-c83a1c11-3511-42a5-ae67-5211a5ca3f17 tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:30:04.479634 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-c83a1c11-3511-42a5-ae67-5211a5ca3f17 tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] [instance: 150a6155-aec7-449b-88f4-aab89d373ddc] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:30:04.494508 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-c83a1c11-3511-42a5-ae67-5211a5ca3f17 tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:30:04.495036 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-c83a1c11-3511-42a5-ae67-5211a5ca3f17 tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:30:04.496664 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-c83a1c11-3511-42a5-ae67-5211a5ca3f17 tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:30:04.497104 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-c83a1c11-3511-42a5-ae67-5211a5ca3f17 tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:30:04.666044 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-c83a1c11-3511-42a5-ae67-5211a5ca3f17 tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc233897770f47e5bd40fb03afabe49c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9698a0142f494095a93a4e804437bc32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:30:04.673849 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-c83a1c11-3511-42a5-ae67-5211a5ca3f17 tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] 10.222.0.33 "GET /compute/v2.1/servers/150a6155-aec7-449b-88f4-aab89d373ddc" status: 200 len: 1314 microversion: 2.1 time: 0.204368 Jul 18 10:30:04.681161 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 81/170] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:30:04 2022] GET /compute/v2.1/servers/150a6155-aec7-449b-88f4-aab89d373ddc => generated 1314 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:30:04.786303 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-52e0f6b2-d2fa-4522-9277-a4ff72ece739 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:30:04.787033 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-52e0f6b2-d2fa-4522-9277-a4ff72ece739 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] [instance: 78bb7f95-9846-4a59-9f77-a3fe69005eec] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:30:04.792484 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG dbcounter [-] [117879] Writing DB stats nova_cell0:SELECT=2 {{(pid=117879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:30:04.793524 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG dbcounter [-] [117879] Writing DB stats nova_cell0:SELECT=8 {{(pid=117879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:30:04.795618 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-52e0f6b2-d2fa-4522-9277-a4ff72ece739 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:30:04.796284 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-52e0f6b2-d2fa-4522-9277-a4ff72ece739 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:30:04.797349 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-52e0f6b2-d2fa-4522-9277-a4ff72ece739 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:30:04.797977 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-52e0f6b2-d2fa-4522-9277-a4ff72ece739 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:30:04.972100 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-52e0f6b2-d2fa-4522-9277-a4ff72ece739 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a431c9708f4694bc0d514133e76088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a1921237622439bab89676e11477c13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:30:04.981351 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-52e0f6b2-d2fa-4522-9277-a4ff72ece739 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] 10.222.0.33 "GET /compute/v2.1/servers/78bb7f95-9846-4a59-9f77-a3fe69005eec" status: 200 len: 1520 microversion: 2.1 time: 0.198814 Jul 18 10:30:04.992416 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 90/171] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:30:04 2022] GET /compute/v2.1/servers/78bb7f95-9846-4a59-9f77-a3fe69005eec => generated 1520 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:30:05.238427 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [req-0d5d1bd4-4223-402d-a291-5cfeca63e1ef req-76d20d9c-a77c-45be-9a75-48cfb16bfbfd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "150a6155-aec7-449b-88f4-aab89d373ddc", "name": "network-vif-plugged", "status": "completed", "tag": "50378def-8454-4be1-888b-dcffb98de187"}]} {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:30:05.246742 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [req-0d5d1bd4-4223-402d-a291-5cfeca63e1ef req-76d20d9c-a77c-45be-9a75-48cfb16bfbfd service nova] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:30:05.247399 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [req-0d5d1bd4-4223-402d-a291-5cfeca63e1ef req-76d20d9c-a77c-45be-9a75-48cfb16bfbfd service nova] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:30:05.259384 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.compute.server_external_events [req-0d5d1bd4-4223-402d-a291-5cfeca63e1ef req-76d20d9c-a77c-45be-9a75-48cfb16bfbfd service nova] Creating event network-vif-plugged:50378def-8454-4be1-888b-dcffb98de187 for instance 150a6155-aec7-449b-88f4-aab89d373ddc on hv-cinder-83754 Jul 18 10:30:05.265024 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [req-0d5d1bd4-4223-402d-a291-5cfeca63e1ef req-76d20d9c-a77c-45be-9a75-48cfb16bfbfd service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031047 Jul 18 10:30:05.266736 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 82/172] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jul 18 10:30:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:30:05.693390 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-0ea4b425-6be6-4f04-81e6-00537a297fe8 tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:30:05.694761 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-0ea4b425-6be6-4f04-81e6-00537a297fe8 tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] [instance: 150a6155-aec7-449b-88f4-aab89d373ddc] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:30:05.702671 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-0ea4b425-6be6-4f04-81e6-00537a297fe8 tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:30:05.703320 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-0ea4b425-6be6-4f04-81e6-00537a297fe8 tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:30:05.704250 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-0ea4b425-6be6-4f04-81e6-00537a297fe8 tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:30:05.704865 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-0ea4b425-6be6-4f04-81e6-00537a297fe8 tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:30:05.979288 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-0ea4b425-6be6-4f04-81e6-00537a297fe8 tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc233897770f47e5bd40fb03afabe49c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9698a0142f494095a93a4e804437bc32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:30:05.989507 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-0ea4b425-6be6-4f04-81e6-00537a297fe8 tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] 10.222.0.33 "GET /compute/v2.1/servers/150a6155-aec7-449b-88f4-aab89d373ddc" status: 200 len: 1314 microversion: 2.1 time: 0.302034 Jul 18 10:30:05.990251 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 91/173] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:30:05 2022] GET /compute/v2.1/servers/150a6155-aec7-449b-88f4-aab89d373ddc => generated 1314 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:30:06.002711 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-d82b0a24-0e67-4dc1-98fb-8456eca1bb72 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:30:06.003423 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-d82b0a24-0e67-4dc1-98fb-8456eca1bb72 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] [instance: 78bb7f95-9846-4a59-9f77-a3fe69005eec] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:30:06.010391 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-d82b0a24-0e67-4dc1-98fb-8456eca1bb72 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:30:06.011125 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-d82b0a24-0e67-4dc1-98fb-8456eca1bb72 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:30:06.012084 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-d82b0a24-0e67-4dc1-98fb-8456eca1bb72 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:30:06.012544 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-d82b0a24-0e67-4dc1-98fb-8456eca1bb72 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:30:06.151423 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-4c47b0a1-4659-46a7-bf93-fbd25ca52d2b tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-133317386", "imageRef": "2cb02169-9999-411b-8c74-f88c068960fc", "flavorRef": "452", "networks": [{"uuid": "303a42e4-0390-40fa-955b-4c7e6e4064b3"}]}} {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:30:06.209046 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.network.neutron [None req-4c47b0a1-4659-46a7-bf93-fbd25ca52d2b tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] validate_networks() for [('303a42e4-0390-40fa-955b-4c7e6e4064b3', None, None, None, None, None)] {{(pid=117879) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 10:30:06.211973 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-d82b0a24-0e67-4dc1-98fb-8456eca1bb72 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a431c9708f4694bc0d514133e76088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a1921237622439bab89676e11477c13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:30:06.220599 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-d82b0a24-0e67-4dc1-98fb-8456eca1bb72 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] 10.222.0.33 "GET /compute/v2.1/servers/78bb7f95-9846-4a59-9f77-a3fe69005eec" status: 200 len: 1520 microversion: 2.1 time: 0.225507 Jul 18 10:30:06.221343 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 83/174] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:30:05 2022] GET /compute/v2.1/servers/78bb7f95-9846-4a59-9f77-a3fe69005eec => generated 1520 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:30:07.009760 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-416800e5-8353-44ba-b248-8b536fb19f77 tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:30:07.010627 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-416800e5-8353-44ba-b248-8b536fb19f77 tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] [instance: 150a6155-aec7-449b-88f4-aab89d373ddc] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:30:07.021327 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-416800e5-8353-44ba-b248-8b536fb19f77 tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:30:07.022296 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-416800e5-8353-44ba-b248-8b536fb19f77 tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:30:07.023451 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-416800e5-8353-44ba-b248-8b536fb19f77 tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:30:07.023910 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-416800e5-8353-44ba-b248-8b536fb19f77 tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:30:07.335278 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.virt.hardware [None req-4c47b0a1-4659-46a7-bf93-fbd25ca52d2b tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Flavor limits 0:0:0 {{(pid=117879) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 10:30:07.335865 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.virt.hardware [None req-4c47b0a1-4659-46a7-bf93-fbd25ca52d2b tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Image limits 0:0:0 {{(pid=117879) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 10:30:07.336250 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.virt.hardware [None req-4c47b0a1-4659-46a7-bf93-fbd25ca52d2b tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Flavor pref 0:0:0 {{(pid=117879) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 10:30:07.336982 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.virt.hardware [None req-4c47b0a1-4659-46a7-bf93-fbd25ca52d2b tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Image pref 0:0:0 {{(pid=117879) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 10:30:07.337395 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.virt.hardware [None req-4c47b0a1-4659-46a7-bf93-fbd25ca52d2b tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117879) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 10:30:07.347331 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-4c47b0a1-4659-46a7-bf93-fbd25ca52d2b tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:30:07.347973 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-4c47b0a1-4659-46a7-bf93-fbd25ca52d2b tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:30:07.348989 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-4c47b0a1-4659-46a7-bf93-fbd25ca52d2b tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:30:07.349425 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-4c47b0a1-4659-46a7-bf93-fbd25ca52d2b tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:30:07.375305 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.quota [None req-4c47b0a1-4659-46a7-bf93-fbd25ca52d2b tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Getting quotas for project ee6203312784435b8cd1fdfede3fb597. Resources: {'ram', 'cores', 'instances'} {{(pid=117879) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 10:30:07.381061 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.quota [None req-4c47b0a1-4659-46a7-bf93-fbd25ca52d2b tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Getting quotas for user 8c9439cb644548b8b3b5fd5c610757b9 and project ee6203312784435b8cd1fdfede3fb597. Resources: {'ram', 'cores', 'instances'} {{(pid=117879) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 10:30:07.401262 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-416800e5-8353-44ba-b248-8b536fb19f77 tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc233897770f47e5bd40fb03afabe49c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9698a0142f494095a93a4e804437bc32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:30:07.410897 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-4c47b0a1-4659-46a7-bf93-fbd25ca52d2b tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Going to run 1 instances... {{(pid=117879) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 10:30:07.418539 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-4c47b0a1-4659-46a7-bf93-fbd25ca52d2b tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] [instance: 233328a3-8e4b-4ece-8072-1a31d00d730f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2cb02169-9999-411b-8c74-f88c068960fc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117879) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 10:30:07.419309 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-416800e5-8353-44ba-b248-8b536fb19f77 tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] 10.222.0.33 "GET /compute/v2.1/servers/150a6155-aec7-449b-88f4-aab89d373ddc" status: 200 len: 1314 microversion: 2.1 time: 0.416972 Jul 18 10:30:07.420383 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 84/175] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:30:07 2022] GET /compute/v2.1/servers/150a6155-aec7-449b-88f4-aab89d373ddc => generated 1314 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:30:07.432826 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-1da7cc5a-7ead-47ce-9c07-ac9ac1979f5e tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:30:07.437656 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-1da7cc5a-7ead-47ce-9c07-ac9ac1979f5e tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] [instance: 78bb7f95-9846-4a59-9f77-a3fe69005eec] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:30:07.470655 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-1da7cc5a-7ead-47ce-9c07-ac9ac1979f5e tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:30:07.471306 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-1da7cc5a-7ead-47ce-9c07-ac9ac1979f5e tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:30:07.478973 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-1da7cc5a-7ead-47ce-9c07-ac9ac1979f5e tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:30:07.479750 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-1da7cc5a-7ead-47ce-9c07-ac9ac1979f5e tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:30:07.539453 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-4c47b0a1-4659-46a7-bf93-fbd25ca52d2b tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.392244 Jul 18 10:30:07.543064 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 92/176] 10.222.0.33 () {60 vars in 1146 bytes} [Mon Jul 18 10:30:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 1397 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 18 10:30:07.558370 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-a8c2ba86-32c7-4465-a6c6-e5e6931424be tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:30:07.559081 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-a8c2ba86-32c7-4465-a6c6-e5e6931424be tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] [instance: 233328a3-8e4b-4ece-8072-1a31d00d730f] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:30:07.663697 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-a8c2ba86-32c7-4465-a6c6-e5e6931424be tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c9439cb644548b8b3b5fd5c610757b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6203312784435b8cd1fdfede3fb597', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:30:07.675912 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-a8c2ba86-32c7-4465-a6c6-e5e6931424be tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] 10.222.0.33 "GET /compute/v2.1/servers/233328a3-8e4b-4ece-8072-1a31d00d730f" status: 200 len: 1218 microversion: 2.1 time: 0.123673 Jul 18 10:30:07.683562 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 93/177] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:30:07 2022] GET /compute/v2.1/servers/233328a3-8e4b-4ece-8072-1a31d00d730f => generated 1218 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:30:07.745781 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-1da7cc5a-7ead-47ce-9c07-ac9ac1979f5e tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a431c9708f4694bc0d514133e76088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a1921237622439bab89676e11477c13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:30:07.776199 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-1da7cc5a-7ead-47ce-9c07-ac9ac1979f5e tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] 10.222.0.33 "GET /compute/v2.1/servers/78bb7f95-9846-4a59-9f77-a3fe69005eec" status: 200 len: 1520 microversion: 2.1 time: 0.354561 Jul 18 10:30:07.778591 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 85/178] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:30:07 2022] GET /compute/v2.1/servers/78bb7f95-9846-4a59-9f77-a3fe69005eec => generated 1520 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:30:08.438254 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-eb1cda62-1b83-40fc-bfd4-c6069bdd17d4 tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:30:08.438860 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-eb1cda62-1b83-40fc-bfd4-c6069bdd17d4 tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] [instance: 150a6155-aec7-449b-88f4-aab89d373ddc] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:30:08.451384 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-eb1cda62-1b83-40fc-bfd4-c6069bdd17d4 tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:30:08.452151 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-eb1cda62-1b83-40fc-bfd4-c6069bdd17d4 tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:30:08.453138 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-eb1cda62-1b83-40fc-bfd4-c6069bdd17d4 tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:30:08.453724 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-eb1cda62-1b83-40fc-bfd4-c6069bdd17d4 tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:30:08.657311 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-eb1cda62-1b83-40fc-bfd4-c6069bdd17d4 tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc233897770f47e5bd40fb03afabe49c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9698a0142f494095a93a4e804437bc32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:30:08.668391 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-eb1cda62-1b83-40fc-bfd4-c6069bdd17d4 tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] 10.222.0.33 "GET /compute/v2.1/servers/150a6155-aec7-449b-88f4-aab89d373ddc" status: 200 len: 1498 microversion: 2.1 time: 0.236414 Jul 18 10:30:08.669023 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 94/179] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:30:08 2022] GET /compute/v2.1/servers/150a6155-aec7-449b-88f4-aab89d373ddc => generated 1498 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:30:08.699449 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-3a1648cf-d04d-4c60-971e-f0138c475f56 tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:30:08.700690 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-3a1648cf-d04d-4c60-971e-f0138c475f56 tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] [instance: 233328a3-8e4b-4ece-8072-1a31d00d730f] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:30:08.708100 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-3a1648cf-d04d-4c60-971e-f0138c475f56 tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:30:08.708703 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-3a1648cf-d04d-4c60-971e-f0138c475f56 tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:30:08.709599 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-3a1648cf-d04d-4c60-971e-f0138c475f56 tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:30:08.710035 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-3a1648cf-d04d-4c60-971e-f0138c475f56 tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:30:08.795116 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-f8a2f796-5437-49fe-9e6b-b3f45377ea55 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:30:08.796140 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-f8a2f796-5437-49fe-9e6b-b3f45377ea55 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] [instance: 78bb7f95-9846-4a59-9f77-a3fe69005eec] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:30:08.807414 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-f8a2f796-5437-49fe-9e6b-b3f45377ea55 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:30:08.807941 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-f8a2f796-5437-49fe-9e6b-b3f45377ea55 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:30:08.808743 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-f8a2f796-5437-49fe-9e6b-b3f45377ea55 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:30:08.811244 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-f8a2f796-5437-49fe-9e6b-b3f45377ea55 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:30:08.848739 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-3a1648cf-d04d-4c60-971e-f0138c475f56 tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c9439cb644548b8b3b5fd5c610757b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6203312784435b8cd1fdfede3fb597', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:30:08.858586 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-3a1648cf-d04d-4c60-971e-f0138c475f56 tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] 10.222.0.33 "GET /compute/v2.1/servers/233328a3-8e4b-4ece-8072-1a31d00d730f" status: 200 len: 1270 microversion: 2.1 time: 0.166672 Jul 18 10:30:08.863375 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 86/180] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:30:08 2022] GET /compute/v2.1/servers/233328a3-8e4b-4ece-8072-1a31d00d730f => generated 1270 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:30:09.144919 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-f8a2f796-5437-49fe-9e6b-b3f45377ea55 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a431c9708f4694bc0d514133e76088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a1921237622439bab89676e11477c13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:30:09.179536 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-f8a2f796-5437-49fe-9e6b-b3f45377ea55 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] 10.222.0.33 "GET /compute/v2.1/servers/78bb7f95-9846-4a59-9f77-a3fe69005eec" status: 200 len: 1520 microversion: 2.1 time: 0.385954 Jul 18 10:30:09.187146 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 95/181] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:30:08 2022] GET /compute/v2.1/servers/78bb7f95-9846-4a59-9f77-a3fe69005eec => generated 1520 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:30:09.277496 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-517929c1-bf65-40a7-bd16-677d23350fd0 tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:30:09.278097 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-517929c1-bf65-40a7-bd16-677d23350fd0 tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] [instance: 150a6155-aec7-449b-88f4-aab89d373ddc] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:30:09.285658 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-517929c1-bf65-40a7-bd16-677d23350fd0 tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:30:09.286323 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-517929c1-bf65-40a7-bd16-677d23350fd0 tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:30:09.287288 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-517929c1-bf65-40a7-bd16-677d23350fd0 tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:30:09.287919 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-517929c1-bf65-40a7-bd16-677d23350fd0 tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:30:09.316832 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-517929c1-bf65-40a7-bd16-677d23350fd0 tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] [instance: 150a6155-aec7-449b-88f4-aab89d373ddc] Going to try to terminate instance {{(pid=117880) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 10:30:09.437754 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-517929c1-bf65-40a7-bd16-677d23350fd0 tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] 10.222.0.33 "DELETE /compute/v2.1/servers/150a6155-aec7-449b-88f4-aab89d373ddc" status: 204 len: 0 microversion: 2.1 time: 0.163792 Jul 18 10:30:09.438740 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 87/182] 10.222.0.33 () {58 vars in 1238 bytes} [Mon Jul 18 10:30:09 2022] DELETE /compute/v2.1/servers/150a6155-aec7-449b-88f4-aab89d373ddc => generated 0 bytes in 166 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 10:30:09.447513 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-7c76c3de-85a5-4d7b-882e-130269d419f4 tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:30:09.449020 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-7c76c3de-85a5-4d7b-882e-130269d419f4 tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] [instance: 150a6155-aec7-449b-88f4-aab89d373ddc] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:30:09.455204 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-7c76c3de-85a5-4d7b-882e-130269d419f4 tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:30:09.456136 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-7c76c3de-85a5-4d7b-882e-130269d419f4 tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:30:09.456626 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-7c76c3de-85a5-4d7b-882e-130269d419f4 tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:30:09.457210 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-7c76c3de-85a5-4d7b-882e-130269d419f4 tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:30:09.672049 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-7c76c3de-85a5-4d7b-882e-130269d419f4 tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc233897770f47e5bd40fb03afabe49c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9698a0142f494095a93a4e804437bc32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:30:09.675518 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG dbcounter [-] [117879] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:30:09.680834 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-7c76c3de-85a5-4d7b-882e-130269d419f4 tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] 10.222.0.33 "GET /compute/v2.1/servers/150a6155-aec7-449b-88f4-aab89d373ddc" status: 200 len: 1504 microversion: 2.1 time: 0.237091 Jul 18 10:30:09.681578 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 96/183] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:30:09 2022] GET /compute/v2.1/servers/150a6155-aec7-449b-88f4-aab89d373ddc => generated 1504 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:30:09.881495 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-31c64280-16d5-4889-878d-65c5abc60411 tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:30:09.882198 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-31c64280-16d5-4889-878d-65c5abc60411 tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] [instance: 233328a3-8e4b-4ece-8072-1a31d00d730f] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:30:09.889855 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-31c64280-16d5-4889-878d-65c5abc60411 tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:30:09.890305 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-31c64280-16d5-4889-878d-65c5abc60411 tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:30:09.891075 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-31c64280-16d5-4889-878d-65c5abc60411 tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:30:09.891508 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-31c64280-16d5-4889-878d-65c5abc60411 tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:30:10.034951 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-31c64280-16d5-4889-878d-65c5abc60411 tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c9439cb644548b8b3b5fd5c610757b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6203312784435b8cd1fdfede3fb597', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:30:10.042270 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-31c64280-16d5-4889-878d-65c5abc60411 tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] 10.222.0.33 "GET /compute/v2.1/servers/233328a3-8e4b-4ece-8072-1a31d00d730f" status: 200 len: 1318 microversion: 2.1 time: 0.165395 Jul 18 10:30:10.042846 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 88/184] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:30:09 2022] GET /compute/v2.1/servers/233328a3-8e4b-4ece-8072-1a31d00d730f => generated 1318 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:30:10.203390 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-71d5b6cd-bc58-45f8-942e-4a58c3e4d2b8 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:30:10.204036 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-71d5b6cd-bc58-45f8-942e-4a58c3e4d2b8 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] [instance: 78bb7f95-9846-4a59-9f77-a3fe69005eec] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:30:10.211066 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-71d5b6cd-bc58-45f8-942e-4a58c3e4d2b8 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:30:10.211620 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-71d5b6cd-bc58-45f8-942e-4a58c3e4d2b8 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:30:10.212498 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-71d5b6cd-bc58-45f8-942e-4a58c3e4d2b8 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:30:10.213340 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-71d5b6cd-bc58-45f8-942e-4a58c3e4d2b8 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:30:10.449862 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-71d5b6cd-bc58-45f8-942e-4a58c3e4d2b8 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a431c9708f4694bc0d514133e76088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a1921237622439bab89676e11477c13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:30:10.457513 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-71d5b6cd-bc58-45f8-942e-4a58c3e4d2b8 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] 10.222.0.33 "GET /compute/v2.1/servers/78bb7f95-9846-4a59-9f77-a3fe69005eec" status: 200 len: 1520 microversion: 2.1 time: 0.258445 Jul 18 10:30:10.458447 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 97/185] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:30:10 2022] GET /compute/v2.1/servers/78bb7f95-9846-4a59-9f77-a3fe69005eec => generated 1520 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:30:10.698248 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-f4b37d8b-491f-481f-8eaf-46cd1efba231 tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:30:10.699050 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-f4b37d8b-491f-481f-8eaf-46cd1efba231 tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] [instance: 150a6155-aec7-449b-88f4-aab89d373ddc] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:30:10.706101 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-f4b37d8b-491f-481f-8eaf-46cd1efba231 tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:30:10.706718 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-f4b37d8b-491f-481f-8eaf-46cd1efba231 tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:30:10.707773 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-f4b37d8b-491f-481f-8eaf-46cd1efba231 tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:30:10.708337 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-f4b37d8b-491f-481f-8eaf-46cd1efba231 tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:30:11.048115 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-f4b37d8b-491f-481f-8eaf-46cd1efba231 tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc233897770f47e5bd40fb03afabe49c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9698a0142f494095a93a4e804437bc32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:30:11.057500 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-f4b37d8b-491f-481f-8eaf-46cd1efba231 tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] 10.222.0.33 "GET /compute/v2.1/servers/150a6155-aec7-449b-88f4-aab89d373ddc" status: 200 len: 1504 microversion: 2.1 time: 0.362896 Jul 18 10:30:11.059030 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 89/186] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:30:10 2022] GET /compute/v2.1/servers/150a6155-aec7-449b-88f4-aab89d373ddc => generated 1504 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:30:11.064064 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-5cef7dba-ba94-4de5-9c90-5a5880501c60 tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:30:11.064776 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-5cef7dba-ba94-4de5-9c90-5a5880501c60 tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] [instance: 233328a3-8e4b-4ece-8072-1a31d00d730f] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:30:11.072162 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-5cef7dba-ba94-4de5-9c90-5a5880501c60 tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:30:11.072721 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-5cef7dba-ba94-4de5-9c90-5a5880501c60 tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:30:11.073566 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-5cef7dba-ba94-4de5-9c90-5a5880501c60 tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:30:11.074217 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-5cef7dba-ba94-4de5-9c90-5a5880501c60 tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:30:11.411533 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-5cef7dba-ba94-4de5-9c90-5a5880501c60 tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c9439cb644548b8b3b5fd5c610757b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6203312784435b8cd1fdfede3fb597', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:30:11.422761 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-5cef7dba-ba94-4de5-9c90-5a5880501c60 tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] 10.222.0.33 "GET /compute/v2.1/servers/233328a3-8e4b-4ece-8072-1a31d00d730f" status: 200 len: 1318 microversion: 2.1 time: 0.364375 Jul 18 10:30:11.423337 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 98/187] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:30:11 2022] GET /compute/v2.1/servers/233328a3-8e4b-4ece-8072-1a31d00d730f => generated 1318 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:30:11.475059 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-c2bf6811-f311-469b-ad5e-4b0d5e04fbf2 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:30:11.476165 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-c2bf6811-f311-469b-ad5e-4b0d5e04fbf2 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] [instance: 78bb7f95-9846-4a59-9f77-a3fe69005eec] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:30:11.496943 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-c2bf6811-f311-469b-ad5e-4b0d5e04fbf2 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:30:11.497807 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-c2bf6811-f311-469b-ad5e-4b0d5e04fbf2 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:30:11.499154 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-c2bf6811-f311-469b-ad5e-4b0d5e04fbf2 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:30:11.499661 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-c2bf6811-f311-469b-ad5e-4b0d5e04fbf2 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:30:11.532152 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG dbcounter [-] [117880] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:30:12.075995 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-fbb09729-606f-47ac-a321-917899d705f2 tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:30:12.077393 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-fbb09729-606f-47ac-a321-917899d705f2 tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] [instance: 150a6155-aec7-449b-88f4-aab89d373ddc] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:30:12.084148 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-fbb09729-606f-47ac-a321-917899d705f2 tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:30:12.084959 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-fbb09729-606f-47ac-a321-917899d705f2 tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:30:12.085905 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-fbb09729-606f-47ac-a321-917899d705f2 tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:30:12.086470 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-fbb09729-606f-47ac-a321-917899d705f2 tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:30:12.214130 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-c2bf6811-f311-469b-ad5e-4b0d5e04fbf2 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a431c9708f4694bc0d514133e76088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a1921237622439bab89676e11477c13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:30:12.221999 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-c2bf6811-f311-469b-ad5e-4b0d5e04fbf2 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] 10.222.0.33 "GET /compute/v2.1/servers/78bb7f95-9846-4a59-9f77-a3fe69005eec" status: 200 len: 1520 microversion: 2.1 time: 0.751620 Jul 18 10:30:12.222756 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 90/188] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:30:11 2022] GET /compute/v2.1/servers/78bb7f95-9846-4a59-9f77-a3fe69005eec => generated 1520 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:30:12.446271 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-aad9ab1e-057a-44d3-9f36-abae8885ade1 tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:30:12.447009 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-aad9ab1e-057a-44d3-9f36-abae8885ade1 tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] [instance: 233328a3-8e4b-4ece-8072-1a31d00d730f] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:30:12.455767 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-aad9ab1e-057a-44d3-9f36-abae8885ade1 tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:30:12.456311 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-aad9ab1e-057a-44d3-9f36-abae8885ade1 tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:30:12.457856 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-aad9ab1e-057a-44d3-9f36-abae8885ade1 tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:30:12.461815 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-aad9ab1e-057a-44d3-9f36-abae8885ade1 tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:30:12.484877 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-fbb09729-606f-47ac-a321-917899d705f2 tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc233897770f47e5bd40fb03afabe49c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9698a0142f494095a93a4e804437bc32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:30:12.501075 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-fbb09729-606f-47ac-a321-917899d705f2 tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] 10.222.0.33 "GET /compute/v2.1/servers/150a6155-aec7-449b-88f4-aab89d373ddc" status: 200 len: 1504 microversion: 2.1 time: 0.427485 Jul 18 10:30:12.504931 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 99/189] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:30:12 2022] GET /compute/v2.1/servers/150a6155-aec7-449b-88f4-aab89d373ddc => generated 1504 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:30:12.822961 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-aad9ab1e-057a-44d3-9f36-abae8885ade1 tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c9439cb644548b8b3b5fd5c610757b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6203312784435b8cd1fdfede3fb597', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:30:12.842682 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-aad9ab1e-057a-44d3-9f36-abae8885ade1 tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] 10.222.0.33 "GET /compute/v2.1/servers/233328a3-8e4b-4ece-8072-1a31d00d730f" status: 200 len: 1318 microversion: 2.1 time: 0.406053 Jul 18 10:30:12.844747 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 91/190] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:30:12 2022] GET /compute/v2.1/servers/233328a3-8e4b-4ece-8072-1a31d00d730f => generated 1318 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:30:13.131000 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [req-788884e3-7129-4fca-903b-0b515e3401c3 req-608d0ca3-0e9e-4d1e-a182-5f6755f86fb3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "233328a3-8e4b-4ece-8072-1a31d00d730f", "tag": "c7e3d10c-31e5-479a-8314-39f962197adb"}]} {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:30:13.145389 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [req-788884e3-7129-4fca-903b-0b515e3401c3 req-608d0ca3-0e9e-4d1e-a182-5f6755f86fb3 service nova] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:30:13.146339 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [req-788884e3-7129-4fca-903b-0b515e3401c3 req-608d0ca3-0e9e-4d1e-a182-5f6755f86fb3 service nova] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:30:13.184623 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.compute.server_external_events [req-788884e3-7129-4fca-903b-0b515e3401c3 req-608d0ca3-0e9e-4d1e-a182-5f6755f86fb3 service nova] Creating event network-changed:c7e3d10c-31e5-479a-8314-39f962197adb for instance 233328a3-8e4b-4ece-8072-1a31d00d730f on hv-cinder-83754 Jul 18 10:30:13.195122 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [req-788884e3-7129-4fca-903b-0b515e3401c3 req-608d0ca3-0e9e-4d1e-a182-5f6755f86fb3 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070330 Jul 18 10:30:13.198942 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 100/191] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jul 18 10:30:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:30:13.241952 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-c1416ef6-b772-46b6-9c16-42072cce7c3e tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:30:13.242682 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-c1416ef6-b772-46b6-9c16-42072cce7c3e tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] [instance: 78bb7f95-9846-4a59-9f77-a3fe69005eec] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:30:13.251447 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-c1416ef6-b772-46b6-9c16-42072cce7c3e tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:30:13.251902 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-c1416ef6-b772-46b6-9c16-42072cce7c3e tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:30:13.252989 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-c1416ef6-b772-46b6-9c16-42072cce7c3e tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:30:13.261728 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-c1416ef6-b772-46b6-9c16-42072cce7c3e tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:30:13.485512 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-c1416ef6-b772-46b6-9c16-42072cce7c3e tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a431c9708f4694bc0d514133e76088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a1921237622439bab89676e11477c13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:30:13.496106 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-c1416ef6-b772-46b6-9c16-42072cce7c3e tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] 10.222.0.33 "GET /compute/v2.1/servers/78bb7f95-9846-4a59-9f77-a3fe69005eec" status: 200 len: 1520 microversion: 2.1 time: 0.260550 Jul 18 10:30:13.506459 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 92/192] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:30:13 2022] GET /compute/v2.1/servers/78bb7f95-9846-4a59-9f77-a3fe69005eec => generated 1520 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:30:13.521567 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-1d7c3f19-dece-4740-af5c-a31285ddf6af tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:30:13.522272 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-1d7c3f19-dece-4740-af5c-a31285ddf6af tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] [instance: 150a6155-aec7-449b-88f4-aab89d373ddc] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:30:13.530687 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-1d7c3f19-dece-4740-af5c-a31285ddf6af tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:30:13.531261 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-1d7c3f19-dece-4740-af5c-a31285ddf6af tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:30:13.532295 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-1d7c3f19-dece-4740-af5c-a31285ddf6af tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:30:13.534413 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-1d7c3f19-dece-4740-af5c-a31285ddf6af tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:30:13.575366 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-1d7c3f19-dece-4740-af5c-a31285ddf6af tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:30:13.576115 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-1d7c3f19-dece-4740-af5c-a31285ddf6af tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:30:13.576743 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.objects.instance [None req-1d7c3f19-dece-4740-af5c-a31285ddf6af tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] Lazy-loading 'fault' on Instance uuid 150a6155-aec7-449b-88f4-aab89d373ddc {{(pid=117879) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 10:30:13.643377 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-1d7c3f19-dece-4740-af5c-a31285ddf6af tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc233897770f47e5bd40fb03afabe49c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9698a0142f494095a93a4e804437bc32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:30:13.655558 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-1d7c3f19-dece-4740-af5c-a31285ddf6af tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] 10.222.0.33 "GET /compute/v2.1/servers/150a6155-aec7-449b-88f4-aab89d373ddc" status: 200 len: 1304 microversion: 2.1 time: 0.138830 Jul 18 10:30:13.656625 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 101/193] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:30:13 2022] GET /compute/v2.1/servers/150a6155-aec7-449b-88f4-aab89d373ddc => generated 1304 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:30:13.859527 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-d2d51b1c-573b-4132-b15a-45167c54e398 tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:30:13.860021 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-d2d51b1c-573b-4132-b15a-45167c54e398 tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] [instance: 233328a3-8e4b-4ece-8072-1a31d00d730f] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:30:13.881058 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-d2d51b1c-573b-4132-b15a-45167c54e398 tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:30:13.881507 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-d2d51b1c-573b-4132-b15a-45167c54e398 tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:30:13.882321 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-d2d51b1c-573b-4132-b15a-45167c54e398 tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:30:13.882754 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-d2d51b1c-573b-4132-b15a-45167c54e398 tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:30:14.052582 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-d2d51b1c-573b-4132-b15a-45167c54e398 tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c9439cb644548b8b3b5fd5c610757b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6203312784435b8cd1fdfede3fb597', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:30:14.061269 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-d2d51b1c-573b-4132-b15a-45167c54e398 tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] 10.222.0.33 "GET /compute/v2.1/servers/233328a3-8e4b-4ece-8072-1a31d00d730f" status: 200 len: 1318 microversion: 2.1 time: 0.205602 Jul 18 10:30:14.061835 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 93/194] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:30:13 2022] GET /compute/v2.1/servers/233328a3-8e4b-4ece-8072-1a31d00d730f => generated 1318 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:30:14.516099 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-b8a5216e-caf4-4688-9afc-0d4c32e7bbed tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:30:14.516923 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-b8a5216e-caf4-4688-9afc-0d4c32e7bbed tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] [instance: 78bb7f95-9846-4a59-9f77-a3fe69005eec] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:30:14.525488 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-b8a5216e-caf4-4688-9afc-0d4c32e7bbed tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:30:14.525488 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-b8a5216e-caf4-4688-9afc-0d4c32e7bbed tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:30:14.526176 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-b8a5216e-caf4-4688-9afc-0d4c32e7bbed tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:30:14.526780 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-b8a5216e-caf4-4688-9afc-0d4c32e7bbed tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:30:14.674166 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-d917ab39-be28-4721-83fe-03e8d42d11e7 tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:30:14.675436 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-d917ab39-be28-4721-83fe-03e8d42d11e7 tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] [instance: 150a6155-aec7-449b-88f4-aab89d373ddc] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:30:14.683528 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-d917ab39-be28-4721-83fe-03e8d42d11e7 tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:30:14.684273 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-d917ab39-be28-4721-83fe-03e8d42d11e7 tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:30:14.685768 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-d917ab39-be28-4721-83fe-03e8d42d11e7 tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:30:14.686244 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-d917ab39-be28-4721-83fe-03e8d42d11e7 tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:30:14.713116 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-b8a5216e-caf4-4688-9afc-0d4c32e7bbed tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a431c9708f4694bc0d514133e76088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a1921237622439bab89676e11477c13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:30:14.730403 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-b8a5216e-caf4-4688-9afc-0d4c32e7bbed tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] 10.222.0.33 "GET /compute/v2.1/servers/78bb7f95-9846-4a59-9f77-a3fe69005eec" status: 200 len: 1520 microversion: 2.1 time: 0.220015 Jul 18 10:30:14.731545 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 102/195] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:30:14 2022] GET /compute/v2.1/servers/78bb7f95-9846-4a59-9f77-a3fe69005eec => generated 1520 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:30:14.735486 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-d917ab39-be28-4721-83fe-03e8d42d11e7 tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:30:14.735927 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-d917ab39-be28-4721-83fe-03e8d42d11e7 tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:30:14.736384 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.objects.instance [None req-d917ab39-be28-4721-83fe-03e8d42d11e7 tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] Lazy-loading 'fault' on Instance uuid 150a6155-aec7-449b-88f4-aab89d373ddc {{(pid=117880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 10:30:14.787566 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-d917ab39-be28-4721-83fe-03e8d42d11e7 tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc233897770f47e5bd40fb03afabe49c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9698a0142f494095a93a4e804437bc32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:30:14.795512 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-d917ab39-be28-4721-83fe-03e8d42d11e7 tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] 10.222.0.33 "GET /compute/v2.1/servers/150a6155-aec7-449b-88f4-aab89d373ddc" status: 200 len: 1304 microversion: 2.1 time: 0.125363 Jul 18 10:30:14.796956 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 94/196] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:30:14 2022] GET /compute/v2.1/servers/150a6155-aec7-449b-88f4-aab89d373ddc => generated 1304 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:30:15.081323 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-96173478-bb91-4118-813b-5fb09bf984f7 tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:30:15.082064 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-96173478-bb91-4118-813b-5fb09bf984f7 tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] [instance: 233328a3-8e4b-4ece-8072-1a31d00d730f] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:30:15.088869 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-96173478-bb91-4118-813b-5fb09bf984f7 tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:30:15.089837 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-96173478-bb91-4118-813b-5fb09bf984f7 tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:30:15.090838 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-96173478-bb91-4118-813b-5fb09bf984f7 tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:30:15.091491 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-96173478-bb91-4118-813b-5fb09bf984f7 tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:30:15.230996 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [req-6a0500c6-96d6-4cb9-912e-6a1c79342c67 req-5923d897-c6b0-4774-8775-ec421e56edaa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "150a6155-aec7-449b-88f4-aab89d373ddc", "name": "network-vif-deleted", "tag": "50378def-8454-4be1-888b-dcffb98de187"}]} {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:30:15.244391 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [req-6a0500c6-96d6-4cb9-912e-6a1c79342c67 req-5923d897-c6b0-4774-8775-ec421e56edaa service nova] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:30:15.245073 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [req-6a0500c6-96d6-4cb9-912e-6a1c79342c67 req-5923d897-c6b0-4774-8775-ec421e56edaa service nova] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:30:15.245391 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-96173478-bb91-4118-813b-5fb09bf984f7 tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c9439cb644548b8b3b5fd5c610757b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6203312784435b8cd1fdfede3fb597', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:30:15.253474 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-96173478-bb91-4118-813b-5fb09bf984f7 tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] 10.222.0.33 "GET /compute/v2.1/servers/233328a3-8e4b-4ece-8072-1a31d00d730f" status: 200 len: 1318 microversion: 2.1 time: 0.178306 Jul 18 10:30:15.257028 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 103/197] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:30:15 2022] GET /compute/v2.1/servers/233328a3-8e4b-4ece-8072-1a31d00d730f => generated 1318 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:30:15.257853 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.compute.server_external_events [req-6a0500c6-96d6-4cb9-912e-6a1c79342c67 req-5923d897-c6b0-4774-8775-ec421e56edaa service nova] Creating event network-vif-deleted:50378def-8454-4be1-888b-dcffb98de187 for instance 150a6155-aec7-449b-88f4-aab89d373ddc on hv-cinder-83754 Jul 18 10:30:15.268708 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [req-6a0500c6-96d6-4cb9-912e-6a1c79342c67 req-5923d897-c6b0-4774-8775-ec421e56edaa service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043789 Jul 18 10:30:15.270469 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 95/198] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jul 18 10:30:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 10:30:15.747986 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-9f450d9e-51db-489c-890f-c6a1b1857551 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:30:15.749005 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-9f450d9e-51db-489c-890f-c6a1b1857551 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] [instance: 78bb7f95-9846-4a59-9f77-a3fe69005eec] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:30:15.755166 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-9f450d9e-51db-489c-890f-c6a1b1857551 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:30:15.755737 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-9f450d9e-51db-489c-890f-c6a1b1857551 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:30:15.756765 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-9f450d9e-51db-489c-890f-c6a1b1857551 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:30:15.757262 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-9f450d9e-51db-489c-890f-c6a1b1857551 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:30:15.818105 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-14e05b5c-9af7-4e41-a0ee-35378028ad33 tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:30:15.820702 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-14e05b5c-9af7-4e41-a0ee-35378028ad33 tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] [instance: 150a6155-aec7-449b-88f4-aab89d373ddc] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:30:15.830891 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-14e05b5c-9af7-4e41-a0ee-35378028ad33 tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:30:15.831335 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-14e05b5c-9af7-4e41-a0ee-35378028ad33 tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:30:15.832239 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-14e05b5c-9af7-4e41-a0ee-35378028ad33 tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:30:15.832693 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-14e05b5c-9af7-4e41-a0ee-35378028ad33 tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:30:15.867593 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-14e05b5c-9af7-4e41-a0ee-35378028ad33 tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:30:15.868044 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-14e05b5c-9af7-4e41-a0ee-35378028ad33 tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:30:15.868606 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.objects.instance [None req-14e05b5c-9af7-4e41-a0ee-35378028ad33 tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] Lazy-loading 'fault' on Instance uuid 150a6155-aec7-449b-88f4-aab89d373ddc {{(pid=117880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 10:30:15.927300 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-14e05b5c-9af7-4e41-a0ee-35378028ad33 tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc233897770f47e5bd40fb03afabe49c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9698a0142f494095a93a4e804437bc32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:30:15.937651 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-14e05b5c-9af7-4e41-a0ee-35378028ad33 tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] 10.222.0.33 "GET /compute/v2.1/servers/150a6155-aec7-449b-88f4-aab89d373ddc" status: 200 len: 1304 microversion: 2.1 time: 0.127435 Jul 18 10:30:15.938240 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 96/199] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:30:15 2022] GET /compute/v2.1/servers/150a6155-aec7-449b-88f4-aab89d373ddc => generated 1304 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:30:15.944202 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-9f450d9e-51db-489c-890f-c6a1b1857551 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a431c9708f4694bc0d514133e76088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a1921237622439bab89676e11477c13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:30:15.952950 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-9f450d9e-51db-489c-890f-c6a1b1857551 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] 10.222.0.33 "GET /compute/v2.1/servers/78bb7f95-9846-4a59-9f77-a3fe69005eec" status: 200 len: 1520 microversion: 2.1 time: 0.208710 Jul 18 10:30:15.953682 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 104/200] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:30:15 2022] GET /compute/v2.1/servers/78bb7f95-9846-4a59-9f77-a3fe69005eec => generated 1520 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:30:16.272770 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-506ea695-5eb8-41e8-a958-4676db7cb85e tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:30:16.273689 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-506ea695-5eb8-41e8-a958-4676db7cb85e tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] [instance: 233328a3-8e4b-4ece-8072-1a31d00d730f] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:30:16.279922 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-506ea695-5eb8-41e8-a958-4676db7cb85e tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:30:16.280559 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-506ea695-5eb8-41e8-a958-4676db7cb85e tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:30:16.281472 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-506ea695-5eb8-41e8-a958-4676db7cb85e tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:30:16.282054 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-506ea695-5eb8-41e8-a958-4676db7cb85e tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:30:16.492596 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-506ea695-5eb8-41e8-a958-4676db7cb85e tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c9439cb644548b8b3b5fd5c610757b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6203312784435b8cd1fdfede3fb597', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:30:16.504412 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-506ea695-5eb8-41e8-a958-4676db7cb85e tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] 10.222.0.33 "GET /compute/v2.1/servers/233328a3-8e4b-4ece-8072-1a31d00d730f" status: 200 len: 1318 microversion: 2.1 time: 0.234972 Jul 18 10:30:16.512027 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 97/201] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:30:16 2022] GET /compute/v2.1/servers/233328a3-8e4b-4ece-8072-1a31d00d730f => generated 1318 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:30:16.954974 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-b5f0a33c-1a70-4e00-91f3-02daa98497ee tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:30:16.956682 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-b5f0a33c-1a70-4e00-91f3-02daa98497ee tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] [instance: 150a6155-aec7-449b-88f4-aab89d373ddc] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:30:16.962486 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-b5f0a33c-1a70-4e00-91f3-02daa98497ee tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:30:16.962931 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-b5f0a33c-1a70-4e00-91f3-02daa98497ee tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:30:16.963687 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-b5f0a33c-1a70-4e00-91f3-02daa98497ee tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:30:16.964116 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-b5f0a33c-1a70-4e00-91f3-02daa98497ee tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:30:16.971611 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-9daacf50-8c4f-4986-bd2b-2858340383d1 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:30:16.972643 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-9daacf50-8c4f-4986-bd2b-2858340383d1 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] [instance: 78bb7f95-9846-4a59-9f77-a3fe69005eec] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:30:16.980859 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-9daacf50-8c4f-4986-bd2b-2858340383d1 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:30:16.981604 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-9daacf50-8c4f-4986-bd2b-2858340383d1 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:30:16.983144 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-9daacf50-8c4f-4986-bd2b-2858340383d1 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:30:16.983723 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-9daacf50-8c4f-4986-bd2b-2858340383d1 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:30:16.984600 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.wsgi [None req-b5f0a33c-1a70-4e00-91f3-02daa98497ee tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] HTTP exception thrown: Instance 150a6155-aec7-449b-88f4-aab89d373ddc could not be found. Jul 18 10:30:16.986422 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-b5f0a33c-1a70-4e00-91f3-02daa98497ee tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] Request method failure captured: Jul 18 10:30:16.986422 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: request: GET /compute/v2.1/servers/150a6155-aec7-449b-88f4-aab89d373ddc HTTP/1.1 Jul 18 10:30:16.986422 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: Accept: application/json Jul 18 10:30:16.986422 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: Accept-Encoding: identity Jul 18 10:30:16.986422 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: Connection: close Jul 18 10:30:16.986422 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: Content-Length: 0 Jul 18 10:30:16.986422 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: Content-Type: application/json Jul 18 10:30:16.986422 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: Host: 10.222.0.33 Jul 18 10:30:16.986422 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: Openstack-System-Scope: None Jul 18 10:30:16.986422 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: User-Agent: python-urllib3/1.26.9 Jul 18 10:30:16.986422 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Auth-Token: gAAAAABi1TYdXC6eZriRiBXG35R4hZD1rF2BwxNODfLGSzKLogF9euSiBFxhSGCfUCffx2FhgLl_pvVS_LFmCEWVFzUwtZd5Xi5_85-W9ZLsIZ8G7cQIqC3D-QNelFOqyAx1nLcyIWbMcFK9YWfSKQSAdwTZwQdp0HvQhbxRin0aS98jXN3OCDQ Jul 18 10:30:16.986422 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Domain-Id: None Jul 18 10:30:16.986422 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Domain-Name: None Jul 18 10:30:16.986422 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Identity-Status: Confirmed Jul 18 10:30:16.986422 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Is-Admin-Project: True Jul 18 10:30:16.986422 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Project-Domain-Id: default Jul 18 10:30:16.986422 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Project-Domain-Name: Default Jul 18 10:30:16.986422 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Project-Id: 9698a0142f494095a93a4e804437bc32 Jul 18 10:30:16.986422 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Project-Name: tempest-VolumesActionsTest-1071066098 Jul 18 10:30:16.986422 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Role: member,reader Jul 18 10:30:16.986422 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Roles: member,reader Jul 18 10:30:16.987957 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/9698a0142f494095a93a4e804437bc32"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/9698a0142f494095a93a4e804437bc32"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/9698a0142f494095a93a4e804437bc32"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_9698a0142f494095a93a4e804437bc32"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jul 18 10:30:16.987957 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Tenant: tempest-VolumesActionsTest-1071066098 Jul 18 10:30:16.987957 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Tenant-Id: 9698a0142f494095a93a4e804437bc32 Jul 18 10:30:16.987957 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Tenant-Name: tempest-VolumesActionsTest-1071066098 Jul 18 10:30:16.987957 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-User: tempest-VolumesActionsTest-1071066098-project Jul 18 10:30:16.987957 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-User-Domain-Id: default Jul 18 10:30:16.987957 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-User-Domain-Name: Default Jul 18 10:30:16.987957 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-User-Id: bc233897770f47e5bd40fb03afabe49c Jul 18 10:30:16.987957 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-User-Name: tempest-VolumesActionsTest-1071066098-project Jul 18 10:30:16.987957 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: method: > Jul 18 10:30:16.987957 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: exception: Instance 150a6155-aec7-449b-88f4-aab89d373ddc could not be found. Jul 18 10:30:16.987957 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: action_args: {'id': '150a6155-aec7-449b-88f4-aab89d373ddc'} Jul 18 10:30:16.988843 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 10:30:16.988843 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:30:16.988843 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 10:30:16.988843 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 10:30:16.988843 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 10:30:16.988843 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 10:30:16.988843 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 10:30:16.988843 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 10:30:16.988843 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 10:30:16.988843 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 10:30:16.988843 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 150a6155-aec7-449b-88f4-aab89d373ddc could not be found. Jul 18 10:30:16.988843 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi Jul 18 10:30:16.988843 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:30:16.988843 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi Jul 18 10:30:16.988843 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:30:16.988843 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:30:16.988843 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:30:16.988843 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 10:30:16.988843 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 10:30:16.988843 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 10:30:16.990603 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 10:30:16.990603 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 10:30:16.990603 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 10:30:16.990603 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 10:30:16.990603 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 10:30:16.990603 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 10:30:16.990603 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 10:30:16.990603 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 150a6155-aec7-449b-88f4-aab89d373ddc could not be found. Jul 18 10:30:16.990603 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi Jul 18 10:30:16.990603 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:30:16.990603 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi Jul 18 10:30:16.990603 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:30:16.990603 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:30:16.990603 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:30:16.990603 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 10:30:16.990603 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 10:30:16.990603 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 150a6155-aec7-449b-88f4-aab89d373ddc could not be found. Jul 18 10:30:16.990603 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi Jul 18 10:30:16.991859 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-b5f0a33c-1a70-4e00-91f3-02daa98497ee tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] Returning 404 to user: Instance 150a6155-aec7-449b-88f4-aab89d373ddc could not be found. {{(pid=117879) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 10:30:16.991859 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-b5f0a33c-1a70-4e00-91f3-02daa98497ee tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] 10.222.0.33 "GET /compute/v2.1/servers/150a6155-aec7-449b-88f4-aab89d373ddc" status: 404 len: 111 microversion: 2.1 time: 0.036700 Jul 18 10:30:16.991859 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 105/202] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:30:16 2022] GET /compute/v2.1/servers/150a6155-aec7-449b-88f4-aab89d373ddc => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 10:30:17.116043 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-c9ca5a5b-c118-423d-a4ef-f4891d951b1d tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1315780139", "imageRef": "2cb02169-9999-411b-8c74-f88c068960fc", "flavorRef": "452", "networks": [{"uuid": "474c975d-13fe-4438-9075-b3e20c4cc132"}]}} {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:30:17.155610 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-9daacf50-8c4f-4986-bd2b-2858340383d1 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a431c9708f4694bc0d514133e76088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a1921237622439bab89676e11477c13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:30:17.164274 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-9daacf50-8c4f-4986-bd2b-2858340383d1 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] 10.222.0.33 "GET /compute/v2.1/servers/78bb7f95-9846-4a59-9f77-a3fe69005eec" status: 200 len: 1520 microversion: 2.1 time: 0.197246 Jul 18 10:30:17.164871 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 98/203] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:30:16 2022] GET /compute/v2.1/servers/78bb7f95-9846-4a59-9f77-a3fe69005eec => generated 1520 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:30:17.168626 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.network.neutron [None req-c9ca5a5b-c118-423d-a4ef-f4891d951b1d tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] validate_networks() for [('474c975d-13fe-4438-9075-b3e20c4cc132', None, None, None, None, None)] {{(pid=117879) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 10:30:17.357240 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG dbcounter [-] [117879] Writing DB stats nova_cell0:SELECT=2 {{(pid=117879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:30:17.521818 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.virt.hardware [None req-c9ca5a5b-c118-423d-a4ef-f4891d951b1d tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] Flavor limits 0:0:0 {{(pid=117879) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 10:30:17.522227 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.virt.hardware [None req-c9ca5a5b-c118-423d-a4ef-f4891d951b1d tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] Image limits 0:0:0 {{(pid=117879) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 10:30:17.522727 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.virt.hardware [None req-c9ca5a5b-c118-423d-a4ef-f4891d951b1d tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] Flavor pref 0:0:0 {{(pid=117879) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 10:30:17.523137 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.virt.hardware [None req-c9ca5a5b-c118-423d-a4ef-f4891d951b1d tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] Image pref 0:0:0 {{(pid=117879) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 10:30:17.523860 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.virt.hardware [None req-c9ca5a5b-c118-423d-a4ef-f4891d951b1d tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117879) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 10:30:17.528430 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-715d836c-0557-4ac4-9354-4ce909ba484d tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:30:17.529062 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-715d836c-0557-4ac4-9354-4ce909ba484d tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] [instance: 233328a3-8e4b-4ece-8072-1a31d00d730f] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:30:17.532993 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-c9ca5a5b-c118-423d-a4ef-f4891d951b1d tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:30:17.533956 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-c9ca5a5b-c118-423d-a4ef-f4891d951b1d tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:30:17.534929 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-c9ca5a5b-c118-423d-a4ef-f4891d951b1d tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:30:17.535551 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-c9ca5a5b-c118-423d-a4ef-f4891d951b1d tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:30:17.535871 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-715d836c-0557-4ac4-9354-4ce909ba484d tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:30:17.536384 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-715d836c-0557-4ac4-9354-4ce909ba484d tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:30:17.537233 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-715d836c-0557-4ac4-9354-4ce909ba484d tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:30:17.538012 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-715d836c-0557-4ac4-9354-4ce909ba484d tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:30:17.553939 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.quota [None req-c9ca5a5b-c118-423d-a4ef-f4891d951b1d tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] Getting quotas for project 9698a0142f494095a93a4e804437bc32. Resources: {'ram', 'cores', 'instances'} {{(pid=117879) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 10:30:17.557953 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.quota [None req-c9ca5a5b-c118-423d-a4ef-f4891d951b1d tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] Getting quotas for user bc233897770f47e5bd40fb03afabe49c and project 9698a0142f494095a93a4e804437bc32. Resources: {'ram', 'cores', 'instances'} {{(pid=117879) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 10:30:17.569150 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-c9ca5a5b-c118-423d-a4ef-f4891d951b1d tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] Going to run 1 instances... {{(pid=117879) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 10:30:17.571461 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-c9ca5a5b-c118-423d-a4ef-f4891d951b1d tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] [instance: 437b80a6-6436-4f8a-be28-49c9cbde98a0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2cb02169-9999-411b-8c74-f88c068960fc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117879) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 10:30:17.616153 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-c9ca5a5b-c118-423d-a4ef-f4891d951b1d tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.504567 Jul 18 10:30:17.624677 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 106/204] 10.222.0.33 () {60 vars in 1146 bytes} [Mon Jul 18 10:30:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 514 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 18 10:30:17.638367 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-baaf6d5f-1fd8-4fac-8549-9e21e0659d5d tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:30:17.640757 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-baaf6d5f-1fd8-4fac-8549-9e21e0659d5d tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] [instance: 437b80a6-6436-4f8a-be28-49c9cbde98a0] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:30:17.643501 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG dbcounter [-] [117879] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=117879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:30:17.713560 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-715d836c-0557-4ac4-9354-4ce909ba484d tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c9439cb644548b8b3b5fd5c610757b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6203312784435b8cd1fdfede3fb597', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:30:17.723622 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-715d836c-0557-4ac4-9354-4ce909ba484d tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] 10.222.0.33 "GET /compute/v2.1/servers/233328a3-8e4b-4ece-8072-1a31d00d730f" status: 200 len: 1318 microversion: 2.1 time: 0.198884 Jul 18 10:30:17.727910 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 99/205] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:30:17 2022] GET /compute/v2.1/servers/233328a3-8e4b-4ece-8072-1a31d00d730f => generated 1318 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:30:17.733809 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-baaf6d5f-1fd8-4fac-8549-9e21e0659d5d tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc233897770f47e5bd40fb03afabe49c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9698a0142f494095a93a4e804437bc32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:30:17.745496 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-baaf6d5f-1fd8-4fac-8549-9e21e0659d5d tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] 10.222.0.33 "GET /compute/v2.1/servers/437b80a6-6436-4f8a-be28-49c9cbde98a0" status: 200 len: 1214 microversion: 2.1 time: 0.119346 Jul 18 10:30:17.746298 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 107/206] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:30:17 2022] GET /compute/v2.1/servers/437b80a6-6436-4f8a-be28-49c9cbde98a0 => generated 1214 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:30:18.190758 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-0201ae6b-95a0-4135-b3a7-30d052fb069d tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:30:18.192559 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-0201ae6b-95a0-4135-b3a7-30d052fb069d tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] [instance: 78bb7f95-9846-4a59-9f77-a3fe69005eec] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:30:18.201145 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-0201ae6b-95a0-4135-b3a7-30d052fb069d tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:30:18.201916 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-0201ae6b-95a0-4135-b3a7-30d052fb069d tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:30:18.203010 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-0201ae6b-95a0-4135-b3a7-30d052fb069d tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:30:18.203437 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-0201ae6b-95a0-4135-b3a7-30d052fb069d tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:30:18.481536 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-0201ae6b-95a0-4135-b3a7-30d052fb069d tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a431c9708f4694bc0d514133e76088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a1921237622439bab89676e11477c13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:30:18.491485 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-0201ae6b-95a0-4135-b3a7-30d052fb069d tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] 10.222.0.33 "GET /compute/v2.1/servers/78bb7f95-9846-4a59-9f77-a3fe69005eec" status: 200 len: 1520 microversion: 2.1 time: 0.313750 Jul 18 10:30:18.492203 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 100/207] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:30:18 2022] GET /compute/v2.1/servers/78bb7f95-9846-4a59-9f77-a3fe69005eec => generated 1520 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:30:18.742292 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-e7acb620-d498-468c-bc19-8ab6ea80272d tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:30:18.743054 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-e7acb620-d498-468c-bc19-8ab6ea80272d tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] [instance: 233328a3-8e4b-4ece-8072-1a31d00d730f] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:30:18.761712 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-ac24d097-f582-437c-a466-216a905d2f6f tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:30:18.762666 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-ac24d097-f582-437c-a466-216a905d2f6f tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] [instance: 437b80a6-6436-4f8a-be28-49c9cbde98a0] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:30:18.767596 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-e7acb620-d498-468c-bc19-8ab6ea80272d tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:30:18.770035 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-e7acb620-d498-468c-bc19-8ab6ea80272d tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:30:18.770889 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-e7acb620-d498-468c-bc19-8ab6ea80272d tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:30:18.771332 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-e7acb620-d498-468c-bc19-8ab6ea80272d tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:30:18.777319 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-ac24d097-f582-437c-a466-216a905d2f6f tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:30:18.777770 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-ac24d097-f582-437c-a466-216a905d2f6f tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:30:18.778579 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-ac24d097-f582-437c-a466-216a905d2f6f tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:30:18.779014 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-ac24d097-f582-437c-a466-216a905d2f6f tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:30:19.031618 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-ac24d097-f582-437c-a466-216a905d2f6f tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc233897770f47e5bd40fb03afabe49c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9698a0142f494095a93a4e804437bc32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:30:19.041471 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-ac24d097-f582-437c-a466-216a905d2f6f tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] 10.222.0.33 "GET /compute/v2.1/servers/437b80a6-6436-4f8a-be28-49c9cbde98a0" status: 200 len: 1266 microversion: 2.1 time: 0.282323 Jul 18 10:30:19.043339 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 101/208] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:30:18 2022] GET /compute/v2.1/servers/437b80a6-6436-4f8a-be28-49c9cbde98a0 => generated 1266 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:30:19.226094 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-e7acb620-d498-468c-bc19-8ab6ea80272d tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c9439cb644548b8b3b5fd5c610757b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6203312784435b8cd1fdfede3fb597', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:30:19.236887 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-e7acb620-d498-468c-bc19-8ab6ea80272d tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] 10.222.0.33 "GET /compute/v2.1/servers/233328a3-8e4b-4ece-8072-1a31d00d730f" status: 200 len: 1318 microversion: 2.1 time: 0.498361 Jul 18 10:30:19.237631 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 108/209] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:30:18 2022] GET /compute/v2.1/servers/233328a3-8e4b-4ece-8072-1a31d00d730f => generated 1318 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:30:19.522278 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-631beb88-b5d6-4501-bf1c-464298bb1813 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:30:19.525399 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-631beb88-b5d6-4501-bf1c-464298bb1813 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] [instance: 78bb7f95-9846-4a59-9f77-a3fe69005eec] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:30:19.567556 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-631beb88-b5d6-4501-bf1c-464298bb1813 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:30:19.568069 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-631beb88-b5d6-4501-bf1c-464298bb1813 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:30:19.572520 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-631beb88-b5d6-4501-bf1c-464298bb1813 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:30:19.596650 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-631beb88-b5d6-4501-bf1c-464298bb1813 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:30:19.869271 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-631beb88-b5d6-4501-bf1c-464298bb1813 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a431c9708f4694bc0d514133e76088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a1921237622439bab89676e11477c13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:30:19.880788 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-631beb88-b5d6-4501-bf1c-464298bb1813 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] 10.222.0.33 "GET /compute/v2.1/servers/78bb7f95-9846-4a59-9f77-a3fe69005eec" status: 200 len: 1520 microversion: 2.1 time: 0.373317 Jul 18 10:30:19.881564 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 102/210] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:30:19 2022] GET /compute/v2.1/servers/78bb7f95-9846-4a59-9f77-a3fe69005eec => generated 1520 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:30:20.059301 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-1ba0fd5d-57f8-4aef-8cad-8007d3aac0cc tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:30:20.059962 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-1ba0fd5d-57f8-4aef-8cad-8007d3aac0cc tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] [instance: 437b80a6-6436-4f8a-be28-49c9cbde98a0] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:30:20.067385 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-1ba0fd5d-57f8-4aef-8cad-8007d3aac0cc tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:30:20.068078 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-1ba0fd5d-57f8-4aef-8cad-8007d3aac0cc tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:30:20.069081 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-1ba0fd5d-57f8-4aef-8cad-8007d3aac0cc tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:30:20.069686 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-1ba0fd5d-57f8-4aef-8cad-8007d3aac0cc tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:30:20.254825 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-86bb2576-2fa0-4f29-8368-1d3ab842310d tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:30:20.255803 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-86bb2576-2fa0-4f29-8368-1d3ab842310d tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] [instance: 233328a3-8e4b-4ece-8072-1a31d00d730f] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:30:20.264014 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-86bb2576-2fa0-4f29-8368-1d3ab842310d tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:30:20.264765 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-86bb2576-2fa0-4f29-8368-1d3ab842310d tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:30:20.266385 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-86bb2576-2fa0-4f29-8368-1d3ab842310d tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:30:20.267205 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-86bb2576-2fa0-4f29-8368-1d3ab842310d tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:30:20.314702 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-1ba0fd5d-57f8-4aef-8cad-8007d3aac0cc tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc233897770f47e5bd40fb03afabe49c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9698a0142f494095a93a4e804437bc32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:30:20.323212 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-1ba0fd5d-57f8-4aef-8cad-8007d3aac0cc tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] 10.222.0.33 "GET /compute/v2.1/servers/437b80a6-6436-4f8a-be28-49c9cbde98a0" status: 200 len: 1314 microversion: 2.1 time: 0.267953 Jul 18 10:30:20.324168 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 109/211] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:30:20 2022] GET /compute/v2.1/servers/437b80a6-6436-4f8a-be28-49c9cbde98a0 => generated 1314 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:30:20.484746 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-86bb2576-2fa0-4f29-8368-1d3ab842310d tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c9439cb644548b8b3b5fd5c610757b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6203312784435b8cd1fdfede3fb597', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:30:20.492548 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-86bb2576-2fa0-4f29-8368-1d3ab842310d tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] 10.222.0.33 "GET /compute/v2.1/servers/233328a3-8e4b-4ece-8072-1a31d00d730f" status: 200 len: 1318 microversion: 2.1 time: 0.241915 Jul 18 10:30:20.493297 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 103/212] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:30:20 2022] GET /compute/v2.1/servers/233328a3-8e4b-4ece-8072-1a31d00d730f => generated 1318 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:30:20.898015 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-713c42c0-ba11-4e32-8db8-c07f981f56da tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:30:20.898544 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-713c42c0-ba11-4e32-8db8-c07f981f56da tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] [instance: 78bb7f95-9846-4a59-9f77-a3fe69005eec] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:30:20.905882 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-713c42c0-ba11-4e32-8db8-c07f981f56da tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:30:20.906250 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-713c42c0-ba11-4e32-8db8-c07f981f56da tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:30:20.907020 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-713c42c0-ba11-4e32-8db8-c07f981f56da tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:30:20.907449 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-713c42c0-ba11-4e32-8db8-c07f981f56da tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:30:21.139316 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-713c42c0-ba11-4e32-8db8-c07f981f56da tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a431c9708f4694bc0d514133e76088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a1921237622439bab89676e11477c13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:30:21.152709 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-713c42c0-ba11-4e32-8db8-c07f981f56da tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] 10.222.0.33 "GET /compute/v2.1/servers/78bb7f95-9846-4a59-9f77-a3fe69005eec" status: 200 len: 1520 microversion: 2.1 time: 0.258362 Jul 18 10:30:21.162742 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 110/213] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:30:20 2022] GET /compute/v2.1/servers/78bb7f95-9846-4a59-9f77-a3fe69005eec => generated 1520 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:30:21.341109 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-33ffb87f-b00c-4da7-9800-f61fe1a76ca1 tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:30:21.342669 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-33ffb87f-b00c-4da7-9800-f61fe1a76ca1 tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] [instance: 437b80a6-6436-4f8a-be28-49c9cbde98a0] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:30:21.350368 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-33ffb87f-b00c-4da7-9800-f61fe1a76ca1 tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:30:21.351378 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-33ffb87f-b00c-4da7-9800-f61fe1a76ca1 tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:30:21.352817 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-33ffb87f-b00c-4da7-9800-f61fe1a76ca1 tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:30:21.354241 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-33ffb87f-b00c-4da7-9800-f61fe1a76ca1 tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:30:21.452245 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [req-80b268e6-d596-486a-8535-7f356f86e9e3 req-843f3102-a230-460d-8cb1-6a0ae572719c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "437b80a6-6436-4f8a-be28-49c9cbde98a0", "tag": "ec69e42c-a16f-4d5d-9f66-84ab1ea7ce3c"}]} {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:30:21.460653 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [req-80b268e6-d596-486a-8535-7f356f86e9e3 req-843f3102-a230-460d-8cb1-6a0ae572719c service nova] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:30:21.461185 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [req-80b268e6-d596-486a-8535-7f356f86e9e3 req-843f3102-a230-460d-8cb1-6a0ae572719c service nova] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:30:21.473034 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.compute.server_external_events [req-80b268e6-d596-486a-8535-7f356f86e9e3 req-843f3102-a230-460d-8cb1-6a0ae572719c service nova] Creating event network-changed:ec69e42c-a16f-4d5d-9f66-84ab1ea7ce3c for instance 437b80a6-6436-4f8a-be28-49c9cbde98a0 on hv-cinder-83754 Jul 18 10:30:21.479512 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [req-80b268e6-d596-486a-8535-7f356f86e9e3 req-843f3102-a230-460d-8cb1-6a0ae572719c service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030423 Jul 18 10:30:21.480156 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 111/214] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jul 18 10:30:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 10:30:21.510971 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-f88d22f0-b2e4-4916-b4f9-bf578621a451 tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:30:21.511895 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-f88d22f0-b2e4-4916-b4f9-bf578621a451 tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] [instance: 233328a3-8e4b-4ece-8072-1a31d00d730f] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:30:21.518700 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-f88d22f0-b2e4-4916-b4f9-bf578621a451 tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:30:21.519154 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-f88d22f0-b2e4-4916-b4f9-bf578621a451 tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:30:21.519986 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-f88d22f0-b2e4-4916-b4f9-bf578621a451 tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:30:21.520424 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-f88d22f0-b2e4-4916-b4f9-bf578621a451 tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:30:21.529180 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-33ffb87f-b00c-4da7-9800-f61fe1a76ca1 tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc233897770f47e5bd40fb03afabe49c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9698a0142f494095a93a4e804437bc32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:30:21.538230 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-33ffb87f-b00c-4da7-9800-f61fe1a76ca1 tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] 10.222.0.33 "GET /compute/v2.1/servers/437b80a6-6436-4f8a-be28-49c9cbde98a0" status: 200 len: 1314 microversion: 2.1 time: 0.201276 Jul 18 10:30:21.538811 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 104/215] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:30:21 2022] GET /compute/v2.1/servers/437b80a6-6436-4f8a-be28-49c9cbde98a0 => generated 1314 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:30:21.661852 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-f88d22f0-b2e4-4916-b4f9-bf578621a451 tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c9439cb644548b8b3b5fd5c610757b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6203312784435b8cd1fdfede3fb597', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:30:21.669747 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-f88d22f0-b2e4-4916-b4f9-bf578621a451 tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] 10.222.0.33 "GET /compute/v2.1/servers/233328a3-8e4b-4ece-8072-1a31d00d730f" status: 200 len: 1318 microversion: 2.1 time: 0.163885 Jul 18 10:30:21.670288 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 112/216] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:30:21 2022] GET /compute/v2.1/servers/233328a3-8e4b-4ece-8072-1a31d00d730f => generated 1318 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:30:22.169679 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-41540a43-dbf3-4016-82be-a151160f3e8c tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:30:22.170310 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-41540a43-dbf3-4016-82be-a151160f3e8c tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] [instance: 78bb7f95-9846-4a59-9f77-a3fe69005eec] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:30:22.176250 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-41540a43-dbf3-4016-82be-a151160f3e8c tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:30:22.176746 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-41540a43-dbf3-4016-82be-a151160f3e8c tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:30:22.177510 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-41540a43-dbf3-4016-82be-a151160f3e8c tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:30:22.177949 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-41540a43-dbf3-4016-82be-a151160f3e8c tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:30:22.311377 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-41540a43-dbf3-4016-82be-a151160f3e8c tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a431c9708f4694bc0d514133e76088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a1921237622439bab89676e11477c13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:30:22.319527 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-41540a43-dbf3-4016-82be-a151160f3e8c tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] 10.222.0.33 "GET /compute/v2.1/servers/78bb7f95-9846-4a59-9f77-a3fe69005eec" status: 200 len: 1520 microversion: 2.1 time: 0.153611 Jul 18 10:30:22.320095 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 105/217] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:30:22 2022] GET /compute/v2.1/servers/78bb7f95-9846-4a59-9f77-a3fe69005eec => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:30:22.555258 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-f0513995-c0c6-402f-8fcf-e56fc46da4bc tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:30:22.555865 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-f0513995-c0c6-402f-8fcf-e56fc46da4bc tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] [instance: 437b80a6-6436-4f8a-be28-49c9cbde98a0] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:30:22.561870 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-f0513995-c0c6-402f-8fcf-e56fc46da4bc tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:30:22.562319 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-f0513995-c0c6-402f-8fcf-e56fc46da4bc tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:30:22.563080 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-f0513995-c0c6-402f-8fcf-e56fc46da4bc tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:30:22.563513 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-f0513995-c0c6-402f-8fcf-e56fc46da4bc tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:30:22.686630 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-e3744320-a8e1-43bf-892a-7376303c6a08 tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:30:22.687166 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-e3744320-a8e1-43bf-892a-7376303c6a08 tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] [instance: 233328a3-8e4b-4ece-8072-1a31d00d730f] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:30:22.694001 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-e3744320-a8e1-43bf-892a-7376303c6a08 tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:30:22.694437 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-e3744320-a8e1-43bf-892a-7376303c6a08 tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:30:22.695223 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-e3744320-a8e1-43bf-892a-7376303c6a08 tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:30:22.695526 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-f0513995-c0c6-402f-8fcf-e56fc46da4bc tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc233897770f47e5bd40fb03afabe49c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9698a0142f494095a93a4e804437bc32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:30:22.695639 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-e3744320-a8e1-43bf-892a-7376303c6a08 tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:30:22.703083 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-f0513995-c0c6-402f-8fcf-e56fc46da4bc tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] 10.222.0.33 "GET /compute/v2.1/servers/437b80a6-6436-4f8a-be28-49c9cbde98a0" status: 200 len: 1314 microversion: 2.1 time: 0.151632 Jul 18 10:30:22.703663 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 113/218] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:30:22 2022] GET /compute/v2.1/servers/437b80a6-6436-4f8a-be28-49c9cbde98a0 => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:30:22.826654 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-e3744320-a8e1-43bf-892a-7376303c6a08 tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c9439cb644548b8b3b5fd5c610757b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6203312784435b8cd1fdfede3fb597', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:30:22.830177 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG dbcounter [-] [117880] Writing DB stats nova_cell1:SELECT=100 {{(pid=117880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:30:22.835582 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-e3744320-a8e1-43bf-892a-7376303c6a08 tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] 10.222.0.33 "GET /compute/v2.1/servers/233328a3-8e4b-4ece-8072-1a31d00d730f" status: 200 len: 1318 microversion: 2.1 time: 0.153105 Jul 18 10:30:22.836137 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 106/219] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:30:22 2022] GET /compute/v2.1/servers/233328a3-8e4b-4ece-8072-1a31d00d730f => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:30:22.883717 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [req-e2f2d96b-c3c2-486a-b669-ecdb8cd678e8 req-a5049eaa-7cf8-4741-aa67-a385b8c4cc4d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "233328a3-8e4b-4ece-8072-1a31d00d730f", "name": "network-vif-plugged", "status": "completed", "tag": "c7e3d10c-31e5-479a-8314-39f962197adb"}]} {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:30:22.891787 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [req-e2f2d96b-c3c2-486a-b669-ecdb8cd678e8 req-a5049eaa-7cf8-4741-aa67-a385b8c4cc4d service nova] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:30:22.892237 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [req-e2f2d96b-c3c2-486a-b669-ecdb8cd678e8 req-a5049eaa-7cf8-4741-aa67-a385b8c4cc4d service nova] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:30:22.907705 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.compute.server_external_events [req-e2f2d96b-c3c2-486a-b669-ecdb8cd678e8 req-a5049eaa-7cf8-4741-aa67-a385b8c4cc4d service nova] Creating event network-vif-plugged:c7e3d10c-31e5-479a-8314-39f962197adb for instance 233328a3-8e4b-4ece-8072-1a31d00d730f on hv-cinder-83754 Jul 18 10:30:22.912899 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [req-e2f2d96b-c3c2-486a-b669-ecdb8cd678e8 req-a5049eaa-7cf8-4741-aa67-a385b8c4cc4d service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032863 Jul 18 10:30:22.913668 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 114/220] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jul 18 10:30:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:30:23.336071 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-d5f5e31e-797b-44b1-9dea-069bd2034e4c tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:30:23.336706 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-d5f5e31e-797b-44b1-9dea-069bd2034e4c tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] [instance: 78bb7f95-9846-4a59-9f77-a3fe69005eec] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:30:23.342635 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-d5f5e31e-797b-44b1-9dea-069bd2034e4c tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:30:23.343076 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-d5f5e31e-797b-44b1-9dea-069bd2034e4c tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:30:23.343817 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-d5f5e31e-797b-44b1-9dea-069bd2034e4c tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:30:23.344241 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-d5f5e31e-797b-44b1-9dea-069bd2034e4c tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:30:23.480068 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-d5f5e31e-797b-44b1-9dea-069bd2034e4c tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a431c9708f4694bc0d514133e76088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a1921237622439bab89676e11477c13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:30:23.481283 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-d5f5e31e-797b-44b1-9dea-069bd2034e4c tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] 10.222.0.33 "GET /compute/v2.1/servers/78bb7f95-9846-4a59-9f77-a3fe69005eec" status: 200 len: 1520 microversion: 2.1 time: 0.149290 Jul 18 10:30:23.481900 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 107/221] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:30:23 2022] GET /compute/v2.1/servers/78bb7f95-9846-4a59-9f77-a3fe69005eec => generated 1520 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:30:23.719819 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-4fcb66a5-71d4-4bc4-9c60-45fa84fbdc16 tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:30:23.720580 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-4fcb66a5-71d4-4bc4-9c60-45fa84fbdc16 tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] [instance: 437b80a6-6436-4f8a-be28-49c9cbde98a0] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:30:23.727212 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-4fcb66a5-71d4-4bc4-9c60-45fa84fbdc16 tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:30:23.727659 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-4fcb66a5-71d4-4bc4-9c60-45fa84fbdc16 tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:30:23.728412 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-4fcb66a5-71d4-4bc4-9c60-45fa84fbdc16 tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:30:23.729123 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-4fcb66a5-71d4-4bc4-9c60-45fa84fbdc16 tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:30:23.854014 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-e5b82cce-31b2-4690-aef0-cb18b8810e8e tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:30:23.854856 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-e5b82cce-31b2-4690-aef0-cb18b8810e8e tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] [instance: 233328a3-8e4b-4ece-8072-1a31d00d730f] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:30:23.862003 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-4fcb66a5-71d4-4bc4-9c60-45fa84fbdc16 tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc233897770f47e5bd40fb03afabe49c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9698a0142f494095a93a4e804437bc32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:30:23.862973 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-e5b82cce-31b2-4690-aef0-cb18b8810e8e tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:30:23.863515 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-e5b82cce-31b2-4690-aef0-cb18b8810e8e tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:30:23.864647 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-e5b82cce-31b2-4690-aef0-cb18b8810e8e tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:30:23.865282 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-e5b82cce-31b2-4690-aef0-cb18b8810e8e tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:30:23.869381 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-4fcb66a5-71d4-4bc4-9c60-45fa84fbdc16 tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] 10.222.0.33 "GET /compute/v2.1/servers/437b80a6-6436-4f8a-be28-49c9cbde98a0" status: 200 len: 1314 microversion: 2.1 time: 0.153865 Jul 18 10:30:23.870032 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 115/222] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:30:23 2022] GET /compute/v2.1/servers/437b80a6-6436-4f8a-be28-49c9cbde98a0 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:30:23.992964 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-e5b82cce-31b2-4690-aef0-cb18b8810e8e tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c9439cb644548b8b3b5fd5c610757b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6203312784435b8cd1fdfede3fb597', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:30:24.000403 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-e5b82cce-31b2-4690-aef0-cb18b8810e8e tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] 10.222.0.33 "GET /compute/v2.1/servers/233328a3-8e4b-4ece-8072-1a31d00d730f" status: 200 len: 1318 microversion: 2.1 time: 0.151601 Jul 18 10:30:24.000987 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 108/223] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:30:23 2022] GET /compute/v2.1/servers/233328a3-8e4b-4ece-8072-1a31d00d730f => generated 1318 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:30:24.498469 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-9a70bf78-0266-4e2e-89f1-b1bbafa622f1 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:30:24.498998 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-9a70bf78-0266-4e2e-89f1-b1bbafa622f1 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] [instance: 78bb7f95-9846-4a59-9f77-a3fe69005eec] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:30:24.505840 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-9a70bf78-0266-4e2e-89f1-b1bbafa622f1 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:30:24.506349 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-9a70bf78-0266-4e2e-89f1-b1bbafa622f1 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:30:24.507229 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-9a70bf78-0266-4e2e-89f1-b1bbafa622f1 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:30:24.507723 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-9a70bf78-0266-4e2e-89f1-b1bbafa622f1 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:30:24.650193 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-9a70bf78-0266-4e2e-89f1-b1bbafa622f1 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a431c9708f4694bc0d514133e76088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a1921237622439bab89676e11477c13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:30:24.657570 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-9a70bf78-0266-4e2e-89f1-b1bbafa622f1 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] 10.222.0.33 "GET /compute/v2.1/servers/78bb7f95-9846-4a59-9f77-a3fe69005eec" status: 200 len: 1520 microversion: 2.1 time: 0.163269 Jul 18 10:30:24.658136 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 116/224] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:30:24 2022] GET /compute/v2.1/servers/78bb7f95-9846-4a59-9f77-a3fe69005eec => generated 1520 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:30:24.887054 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-194ef904-5e8a-4115-a342-8c24eb1775d8 tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:30:24.888527 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-194ef904-5e8a-4115-a342-8c24eb1775d8 tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] [instance: 437b80a6-6436-4f8a-be28-49c9cbde98a0] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:30:24.895673 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-194ef904-5e8a-4115-a342-8c24eb1775d8 tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:30:24.896127 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-194ef904-5e8a-4115-a342-8c24eb1775d8 tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:30:24.896975 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-194ef904-5e8a-4115-a342-8c24eb1775d8 tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:30:24.897603 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-194ef904-5e8a-4115-a342-8c24eb1775d8 tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:30:25.019506 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-d5e44258-9cce-45bb-b793-a15829195f82 tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:30:25.020392 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-d5e44258-9cce-45bb-b793-a15829195f82 tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] [instance: 233328a3-8e4b-4ece-8072-1a31d00d730f] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:30:25.031205 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-d5e44258-9cce-45bb-b793-a15829195f82 tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:30:25.031754 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-d5e44258-9cce-45bb-b793-a15829195f82 tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:30:25.033579 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-d5e44258-9cce-45bb-b793-a15829195f82 tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:30:25.034327 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-d5e44258-9cce-45bb-b793-a15829195f82 tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:30:25.056263 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG dbcounter [-] [117879] Writing DB stats nova_cell1:SELECT=100 {{(pid=117879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:30:25.344481 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-194ef904-5e8a-4115-a342-8c24eb1775d8 tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc233897770f47e5bd40fb03afabe49c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9698a0142f494095a93a4e804437bc32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:30:25.354039 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-194ef904-5e8a-4115-a342-8c24eb1775d8 tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] 10.222.0.33 "GET /compute/v2.1/servers/437b80a6-6436-4f8a-be28-49c9cbde98a0" status: 200 len: 1314 microversion: 2.1 time: 0.470717 Jul 18 10:30:25.354811 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 109/225] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:30:24 2022] GET /compute/v2.1/servers/437b80a6-6436-4f8a-be28-49c9cbde98a0 => generated 1314 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:30:25.405690 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-d5e44258-9cce-45bb-b793-a15829195f82 tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c9439cb644548b8b3b5fd5c610757b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6203312784435b8cd1fdfede3fb597', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:30:25.414120 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-d5e44258-9cce-45bb-b793-a15829195f82 tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] 10.222.0.33 "GET /compute/v2.1/servers/233328a3-8e4b-4ece-8072-1a31d00d730f" status: 200 len: 1318 microversion: 2.1 time: 0.399826 Jul 18 10:30:25.414779 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 117/226] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:30:25 2022] GET /compute/v2.1/servers/233328a3-8e4b-4ece-8072-1a31d00d730f => generated 1318 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:30:25.674646 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-aa79d544-d1f4-41af-b631-781eedbf9949 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:30:25.675565 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-aa79d544-d1f4-41af-b631-781eedbf9949 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] [instance: 78bb7f95-9846-4a59-9f77-a3fe69005eec] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:30:25.682740 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-aa79d544-d1f4-41af-b631-781eedbf9949 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:30:25.683368 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-aa79d544-d1f4-41af-b631-781eedbf9949 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:30:25.684309 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-aa79d544-d1f4-41af-b631-781eedbf9949 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:30:25.685118 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-aa79d544-d1f4-41af-b631-781eedbf9949 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:30:25.910546 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-aa79d544-d1f4-41af-b631-781eedbf9949 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a431c9708f4694bc0d514133e76088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a1921237622439bab89676e11477c13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:30:25.919330 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-aa79d544-d1f4-41af-b631-781eedbf9949 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] 10.222.0.33 "GET /compute/v2.1/servers/78bb7f95-9846-4a59-9f77-a3fe69005eec" status: 200 len: 1520 microversion: 2.1 time: 0.248773 Jul 18 10:30:25.920139 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 110/227] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:30:25 2022] GET /compute/v2.1/servers/78bb7f95-9846-4a59-9f77-a3fe69005eec => generated 1520 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:30:26.371465 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-e1b4c75f-706b-44a7-a2a4-6d22fa99774c tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:30:26.372069 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-e1b4c75f-706b-44a7-a2a4-6d22fa99774c tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] [instance: 437b80a6-6436-4f8a-be28-49c9cbde98a0] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:30:26.378958 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-e1b4c75f-706b-44a7-a2a4-6d22fa99774c tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:30:26.379409 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-e1b4c75f-706b-44a7-a2a4-6d22fa99774c tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:30:26.380158 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-e1b4c75f-706b-44a7-a2a4-6d22fa99774c tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:30:26.380614 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-e1b4c75f-706b-44a7-a2a4-6d22fa99774c tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:30:26.431147 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-94a6dc59-ac65-448f-ae90-dcc27b99dcdf tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:30:26.431754 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-94a6dc59-ac65-448f-ae90-dcc27b99dcdf tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] [instance: 233328a3-8e4b-4ece-8072-1a31d00d730f] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:30:26.437958 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-94a6dc59-ac65-448f-ae90-dcc27b99dcdf tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:30:26.438606 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-94a6dc59-ac65-448f-ae90-dcc27b99dcdf tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:30:26.440138 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-94a6dc59-ac65-448f-ae90-dcc27b99dcdf tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:30:26.440778 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-94a6dc59-ac65-448f-ae90-dcc27b99dcdf tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:30:26.585430 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-e1b4c75f-706b-44a7-a2a4-6d22fa99774c tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc233897770f47e5bd40fb03afabe49c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9698a0142f494095a93a4e804437bc32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:30:26.597259 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-e1b4c75f-706b-44a7-a2a4-6d22fa99774c tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] 10.222.0.33 "GET /compute/v2.1/servers/437b80a6-6436-4f8a-be28-49c9cbde98a0" status: 200 len: 1314 microversion: 2.1 time: 0.228908 Jul 18 10:30:26.598366 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 118/228] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:30:26 2022] GET /compute/v2.1/servers/437b80a6-6436-4f8a-be28-49c9cbde98a0 => generated 1314 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:30:26.610495 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-94a6dc59-ac65-448f-ae90-dcc27b99dcdf tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c9439cb644548b8b3b5fd5c610757b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6203312784435b8cd1fdfede3fb597', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:30:26.618678 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-94a6dc59-ac65-448f-ae90-dcc27b99dcdf tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] 10.222.0.33 "GET /compute/v2.1/servers/233328a3-8e4b-4ece-8072-1a31d00d730f" status: 200 len: 1318 microversion: 2.1 time: 0.191350 Jul 18 10:30:26.619245 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 111/229] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:30:26 2022] GET /compute/v2.1/servers/233328a3-8e4b-4ece-8072-1a31d00d730f => generated 1318 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:30:26.937506 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-553f63e0-9563-497d-94d9-3412cde136ef tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:30:26.938287 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-553f63e0-9563-497d-94d9-3412cde136ef tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] [instance: 78bb7f95-9846-4a59-9f77-a3fe69005eec] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:30:26.944237 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-553f63e0-9563-497d-94d9-3412cde136ef tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:30:26.944797 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-553f63e0-9563-497d-94d9-3412cde136ef tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:30:26.945687 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-553f63e0-9563-497d-94d9-3412cde136ef tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:30:26.946294 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-553f63e0-9563-497d-94d9-3412cde136ef tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:30:27.083377 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-553f63e0-9563-497d-94d9-3412cde136ef tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a431c9708f4694bc0d514133e76088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a1921237622439bab89676e11477c13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:30:27.092962 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-553f63e0-9563-497d-94d9-3412cde136ef tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] 10.222.0.33 "GET /compute/v2.1/servers/78bb7f95-9846-4a59-9f77-a3fe69005eec" status: 200 len: 1500 microversion: 2.1 time: 0.159449 Jul 18 10:30:27.104651 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 119/230] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:30:26 2022] GET /compute/v2.1/servers/78bb7f95-9846-4a59-9f77-a3fe69005eec => generated 1500 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:30:27.112014 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-653ebe8d-8103-4d3e-939b-b83e4e8db4f3 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:30:27.112687 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-653ebe8d-8103-4d3e-939b-b83e4e8db4f3 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] [instance: 591fab72-3729-4b6f-af75-cc55766b7eae] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:30:27.119435 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-653ebe8d-8103-4d3e-939b-b83e4e8db4f3 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:30:27.119897 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-653ebe8d-8103-4d3e-939b-b83e4e8db4f3 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:30:27.121094 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-653ebe8d-8103-4d3e-939b-b83e4e8db4f3 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:30:27.121572 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-653ebe8d-8103-4d3e-939b-b83e4e8db4f3 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:30:27.271905 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-653ebe8d-8103-4d3e-939b-b83e4e8db4f3 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a431c9708f4694bc0d514133e76088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a1921237622439bab89676e11477c13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:30:27.280278 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-653ebe8d-8103-4d3e-939b-b83e4e8db4f3 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] 10.222.0.33 "GET /compute/v2.1/servers/591fab72-3729-4b6f-af75-cc55766b7eae" status: 200 len: 1516 microversion: 2.1 time: 0.173832 Jul 18 10:30:27.281030 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 112/231] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:30:27 2022] GET /compute/v2.1/servers/591fab72-3729-4b6f-af75-cc55766b7eae => generated 1516 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:30:27.615133 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-488d213f-717a-47c7-b3ab-2abbf6305bf9 tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:30:27.615777 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-488d213f-717a-47c7-b3ab-2abbf6305bf9 tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] [instance: 437b80a6-6436-4f8a-be28-49c9cbde98a0] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:30:27.618537 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG dbcounter [-] [117879] Writing DB stats nova_cell0:SELECT=2 {{(pid=117879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:30:27.627135 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-488d213f-717a-47c7-b3ab-2abbf6305bf9 tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:30:27.627903 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-488d213f-717a-47c7-b3ab-2abbf6305bf9 tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:30:27.632684 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-488d213f-717a-47c7-b3ab-2abbf6305bf9 tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:30:27.633182 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-488d213f-717a-47c7-b3ab-2abbf6305bf9 tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:30:27.641124 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-9b9ae8e1-b8f3-4b64-9246-97789825d215 tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:30:27.641784 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-9b9ae8e1-b8f3-4b64-9246-97789825d215 tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] [instance: 233328a3-8e4b-4ece-8072-1a31d00d730f] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:30:27.649727 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-9b9ae8e1-b8f3-4b64-9246-97789825d215 tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:30:27.650739 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-9b9ae8e1-b8f3-4b64-9246-97789825d215 tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:30:27.651737 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-9b9ae8e1-b8f3-4b64-9246-97789825d215 tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:30:27.652384 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-9b9ae8e1-b8f3-4b64-9246-97789825d215 tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:30:27.737847 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG dbcounter [-] [117879] Writing DB stats nova_cell0:SELECT=16 {{(pid=117879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:30:27.913835 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-488d213f-717a-47c7-b3ab-2abbf6305bf9 tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc233897770f47e5bd40fb03afabe49c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9698a0142f494095a93a4e804437bc32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:30:27.936482 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-9b9ae8e1-b8f3-4b64-9246-97789825d215 tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c9439cb644548b8b3b5fd5c610757b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6203312784435b8cd1fdfede3fb597', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:30:27.950019 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-488d213f-717a-47c7-b3ab-2abbf6305bf9 tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] 10.222.0.33 "GET /compute/v2.1/servers/437b80a6-6436-4f8a-be28-49c9cbde98a0" status: 200 len: 1314 microversion: 2.1 time: 0.338711 Jul 18 10:30:27.950601 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-9b9ae8e1-b8f3-4b64-9246-97789825d215 tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] 10.222.0.33 "GET /compute/v2.1/servers/233328a3-8e4b-4ece-8072-1a31d00d730f" status: 200 len: 1507 microversion: 2.1 time: 0.317115 Jul 18 10:30:27.959788 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 120/232] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:30:27 2022] GET /compute/v2.1/servers/437b80a6-6436-4f8a-be28-49c9cbde98a0 => generated 1314 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:30:27.960196 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 113/233] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:30:27 2022] GET /compute/v2.1/servers/233328a3-8e4b-4ece-8072-1a31d00d730f => generated 1507 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:30:28.967288 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-40b7784e-8fdd-428f-8de0-1b764e021e78 tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:30:28.967861 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-40b7784e-8fdd-428f-8de0-1b764e021e78 tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] [instance: 437b80a6-6436-4f8a-be28-49c9cbde98a0] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:30:28.974903 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-40b7784e-8fdd-428f-8de0-1b764e021e78 tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:30:28.975358 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-40b7784e-8fdd-428f-8de0-1b764e021e78 tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:30:28.976158 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-40b7784e-8fdd-428f-8de0-1b764e021e78 tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:30:28.976620 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-40b7784e-8fdd-428f-8de0-1b764e021e78 tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:30:28.989758 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-02935818-5e74-45f7-a15c-946baaa68d05 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:30:28.990846 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-02935818-5e74-45f7-a15c-946baaa68d05 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] [instance: 591fab72-3729-4b6f-af75-cc55766b7eae] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:30:29.011921 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-02935818-5e74-45f7-a15c-946baaa68d05 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:30:29.012314 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-02935818-5e74-45f7-a15c-946baaa68d05 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:30:29.013138 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-02935818-5e74-45f7-a15c-946baaa68d05 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:30:29.019293 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-02935818-5e74-45f7-a15c-946baaa68d05 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:30:29.074191 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.objects.instance [None req-02935818-5e74-45f7-a15c-946baaa68d05 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lazy-loading 'flavor' on Instance uuid 591fab72-3729-4b6f-af75-cc55766b7eae {{(pid=117880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 10:30:29.224097 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-40b7784e-8fdd-428f-8de0-1b764e021e78 tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc233897770f47e5bd40fb03afabe49c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9698a0142f494095a93a4e804437bc32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:30:29.234753 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-40b7784e-8fdd-428f-8de0-1b764e021e78 tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] 10.222.0.33 "GET /compute/v2.1/servers/437b80a6-6436-4f8a-be28-49c9cbde98a0" status: 200 len: 1314 microversion: 2.1 time: 0.270626 Jul 18 10:30:29.236286 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 121/234] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:30:28 2022] GET /compute/v2.1/servers/437b80a6-6436-4f8a-be28-49c9cbde98a0 => generated 1314 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:30:29.237857 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-02935818-5e74-45f7-a15c-946baaa68d05 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] 10.222.0.33 "POST /compute/v2.1/servers/591fab72-3729-4b6f-af75-cc55766b7eae/action" status: 200 len: 32 microversion: 2.1 time: 0.253449 Jul 18 10:30:29.238468 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 114/235] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Jul 18 10:30:28 2022] POST /compute/v2.1/servers/591fab72-3729-4b6f-af75-cc55766b7eae/action => generated 32 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 18 10:30:29.249758 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-3333dab6-aa91-489e-88c3-f2e46770b28b tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:30:29.251497 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-3333dab6-aa91-489e-88c3-f2e46770b28b tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] [instance: 591fab72-3729-4b6f-af75-cc55766b7eae] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:30:29.257705 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-3333dab6-aa91-489e-88c3-f2e46770b28b tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:30:29.258157 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-3333dab6-aa91-489e-88c3-f2e46770b28b tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:30:29.258935 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-3333dab6-aa91-489e-88c3-f2e46770b28b tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:30:29.259391 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-3333dab6-aa91-489e-88c3-f2e46770b28b tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:30:29.394463 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-3333dab6-aa91-489e-88c3-f2e46770b28b tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a431c9708f4694bc0d514133e76088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a1921237622439bab89676e11477c13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:30:29.402046 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-3333dab6-aa91-489e-88c3-f2e46770b28b tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] 10.222.0.33 "GET /compute/v2.1/servers/591fab72-3729-4b6f-af75-cc55766b7eae" status: 200 len: 1522 microversion: 2.1 time: 0.156273 Jul 18 10:30:29.402617 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 122/236] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:30:29 2022] GET /compute/v2.1/servers/591fab72-3729-4b6f-af75-cc55766b7eae => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:30:30.255546 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-70e108e8-8cfe-477e-924b-21f2c67edebb tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:30:30.256389 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-70e108e8-8cfe-477e-924b-21f2c67edebb tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] [instance: 437b80a6-6436-4f8a-be28-49c9cbde98a0] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:30:30.270628 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-70e108e8-8cfe-477e-924b-21f2c67edebb tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:30:30.271072 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-70e108e8-8cfe-477e-924b-21f2c67edebb tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:30:30.271840 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-70e108e8-8cfe-477e-924b-21f2c67edebb tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:30:30.272272 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-70e108e8-8cfe-477e-924b-21f2c67edebb tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:30:30.406857 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-70e108e8-8cfe-477e-924b-21f2c67edebb tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc233897770f47e5bd40fb03afabe49c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9698a0142f494095a93a4e804437bc32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:30:30.414311 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-70e108e8-8cfe-477e-924b-21f2c67edebb tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] 10.222.0.33 "GET /compute/v2.1/servers/437b80a6-6436-4f8a-be28-49c9cbde98a0" status: 200 len: 1314 microversion: 2.1 time: 0.164737 Jul 18 10:30:30.415242 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 115/237] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:30:30 2022] GET /compute/v2.1/servers/437b80a6-6436-4f8a-be28-49c9cbde98a0 => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:30:30.429209 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-9ea789ff-9411-46de-874a-38df67b86d13 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:30:30.430013 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-9ea789ff-9411-46de-874a-38df67b86d13 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] [instance: 591fab72-3729-4b6f-af75-cc55766b7eae] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:30:30.436912 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-9ea789ff-9411-46de-874a-38df67b86d13 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:30:30.437384 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-9ea789ff-9411-46de-874a-38df67b86d13 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:30:30.438160 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-9ea789ff-9411-46de-874a-38df67b86d13 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:30:30.438610 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-9ea789ff-9411-46de-874a-38df67b86d13 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:30:30.595906 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-9ea789ff-9411-46de-874a-38df67b86d13 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a431c9708f4694bc0d514133e76088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a1921237622439bab89676e11477c13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:30:30.604353 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-9ea789ff-9411-46de-874a-38df67b86d13 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] 10.222.0.33 "GET /compute/v2.1/servers/591fab72-3729-4b6f-af75-cc55766b7eae" status: 200 len: 1522 microversion: 2.1 time: 0.186878 Jul 18 10:30:30.604949 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 123/238] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:30:30 2022] GET /compute/v2.1/servers/591fab72-3729-4b6f-af75-cc55766b7eae => generated 1522 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:30:31.431531 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-b05f4e3b-af71-4dbd-a0c4-094ca8f5c4fa tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:30:31.432837 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-b05f4e3b-af71-4dbd-a0c4-094ca8f5c4fa tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] [instance: 437b80a6-6436-4f8a-be28-49c9cbde98a0] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:30:31.449618 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-b05f4e3b-af71-4dbd-a0c4-094ca8f5c4fa tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:30:31.449618 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-b05f4e3b-af71-4dbd-a0c4-094ca8f5c4fa tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:30:31.449618 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-b05f4e3b-af71-4dbd-a0c4-094ca8f5c4fa tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:30:31.449618 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-b05f4e3b-af71-4dbd-a0c4-094ca8f5c4fa tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:30:31.589802 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-b05f4e3b-af71-4dbd-a0c4-094ca8f5c4fa tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc233897770f47e5bd40fb03afabe49c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9698a0142f494095a93a4e804437bc32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:30:31.599517 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-b05f4e3b-af71-4dbd-a0c4-094ca8f5c4fa tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] 10.222.0.33 "GET /compute/v2.1/servers/437b80a6-6436-4f8a-be28-49c9cbde98a0" status: 200 len: 1314 microversion: 2.1 time: 0.172027 Jul 18 10:30:31.601125 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 116/239] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:30:31 2022] GET /compute/v2.1/servers/437b80a6-6436-4f8a-be28-49c9cbde98a0 => generated 1314 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:30:31.622792 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-4b8c2ba2-6e5b-4d55-8a02-b34315040cb1 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:30:31.623826 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-4b8c2ba2-6e5b-4d55-8a02-b34315040cb1 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] [instance: 591fab72-3729-4b6f-af75-cc55766b7eae] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:30:31.630891 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-4b8c2ba2-6e5b-4d55-8a02-b34315040cb1 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:30:31.631466 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-4b8c2ba2-6e5b-4d55-8a02-b34315040cb1 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:30:31.632649 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-4b8c2ba2-6e5b-4d55-8a02-b34315040cb1 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:30:31.633245 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-4b8c2ba2-6e5b-4d55-8a02-b34315040cb1 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:30:31.776418 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-4b8c2ba2-6e5b-4d55-8a02-b34315040cb1 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a431c9708f4694bc0d514133e76088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a1921237622439bab89676e11477c13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:30:31.784146 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-4b8c2ba2-6e5b-4d55-8a02-b34315040cb1 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] 10.222.0.33 "GET /compute/v2.1/servers/591fab72-3729-4b6f-af75-cc55766b7eae" status: 200 len: 1522 microversion: 2.1 time: 0.166260 Jul 18 10:30:31.784752 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 124/240] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:30:31 2022] GET /compute/v2.1/servers/591fab72-3729-4b6f-af75-cc55766b7eae => generated 1522 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:30:32.618960 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-e9065882-a04c-47ff-b87b-e96c3c60e97a tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:30:32.619569 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-e9065882-a04c-47ff-b87b-e96c3c60e97a tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] [instance: 437b80a6-6436-4f8a-be28-49c9cbde98a0] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:30:32.635856 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG dbcounter [-] [117880] Writing DB stats nova_api:SELECT=87,nova_api:UPDATE=1 {{(pid=117880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:30:32.637911 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-e9065882-a04c-47ff-b87b-e96c3c60e97a tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:30:32.638360 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-e9065882-a04c-47ff-b87b-e96c3c60e97a tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:30:32.639188 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-e9065882-a04c-47ff-b87b-e96c3c60e97a tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:30:32.639774 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-e9065882-a04c-47ff-b87b-e96c3c60e97a tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:30:32.803105 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-35448889-27a5-4271-9c9c-4773783b0c30 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:30:32.803720 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-35448889-27a5-4271-9c9c-4773783b0c30 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] [instance: 591fab72-3729-4b6f-af75-cc55766b7eae] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:30:32.826204 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-35448889-27a5-4271-9c9c-4773783b0c30 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:30:32.827007 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-35448889-27a5-4271-9c9c-4773783b0c30 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:30:32.828052 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-35448889-27a5-4271-9c9c-4773783b0c30 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:30:32.828792 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-35448889-27a5-4271-9c9c-4773783b0c30 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:30:33.065066 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-e9065882-a04c-47ff-b87b-e96c3c60e97a tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc233897770f47e5bd40fb03afabe49c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9698a0142f494095a93a4e804437bc32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:30:33.078049 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-e9065882-a04c-47ff-b87b-e96c3c60e97a tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] 10.222.0.33 "GET /compute/v2.1/servers/437b80a6-6436-4f8a-be28-49c9cbde98a0" status: 200 len: 1314 microversion: 2.1 time: 0.462657 Jul 18 10:30:33.088108 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-35448889-27a5-4271-9c9c-4773783b0c30 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a431c9708f4694bc0d514133e76088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a1921237622439bab89676e11477c13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:30:33.088959 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 117/241] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:30:32 2022] GET /compute/v2.1/servers/437b80a6-6436-4f8a-be28-49c9cbde98a0 => generated 1314 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:30:33.093855 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-35448889-27a5-4271-9c9c-4773783b0c30 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] 10.222.0.33 "GET /compute/v2.1/servers/591fab72-3729-4b6f-af75-cc55766b7eae" status: 200 len: 1522 microversion: 2.1 time: 0.296123 Jul 18 10:30:33.094978 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 125/242] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:30:32 2022] GET /compute/v2.1/servers/591fab72-3729-4b6f-af75-cc55766b7eae => generated 1522 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:30:34.095930 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-0b4527b0-e7d8-4f24-9e3c-fc9cbdab469d tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:30:34.096460 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-0b4527b0-e7d8-4f24-9e3c-fc9cbdab469d tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] [instance: 437b80a6-6436-4f8a-be28-49c9cbde98a0] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:30:34.103227 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-0b4527b0-e7d8-4f24-9e3c-fc9cbdab469d tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:30:34.104129 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-0b4527b0-e7d8-4f24-9e3c-fc9cbdab469d tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:30:34.104969 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-0b4527b0-e7d8-4f24-9e3c-fc9cbdab469d tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:30:34.105393 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-0b4527b0-e7d8-4f24-9e3c-fc9cbdab469d tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:30:34.111712 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-46b5ae97-9d36-4c83-842b-d6e1fb5c5ec6 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:30:34.112842 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-46b5ae97-9d36-4c83-842b-d6e1fb5c5ec6 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] [instance: 591fab72-3729-4b6f-af75-cc55766b7eae] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:30:34.119106 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-46b5ae97-9d36-4c83-842b-d6e1fb5c5ec6 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:30:34.119554 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-46b5ae97-9d36-4c83-842b-d6e1fb5c5ec6 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:30:34.120319 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-46b5ae97-9d36-4c83-842b-d6e1fb5c5ec6 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:30:34.120874 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-46b5ae97-9d36-4c83-842b-d6e1fb5c5ec6 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:30:34.324213 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-0b4527b0-e7d8-4f24-9e3c-fc9cbdab469d tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc233897770f47e5bd40fb03afabe49c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9698a0142f494095a93a4e804437bc32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:30:34.329082 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-46b5ae97-9d36-4c83-842b-d6e1fb5c5ec6 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a431c9708f4694bc0d514133e76088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a1921237622439bab89676e11477c13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:30:34.333323 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-0b4527b0-e7d8-4f24-9e3c-fc9cbdab469d tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] 10.222.0.33 "GET /compute/v2.1/servers/437b80a6-6436-4f8a-be28-49c9cbde98a0" status: 200 len: 1314 microversion: 2.1 time: 0.241826 Jul 18 10:30:34.333893 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 118/243] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:30:34 2022] GET /compute/v2.1/servers/437b80a6-6436-4f8a-be28-49c9cbde98a0 => generated 1314 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:30:34.339975 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-46b5ae97-9d36-4c83-842b-d6e1fb5c5ec6 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] 10.222.0.33 "GET /compute/v2.1/servers/591fab72-3729-4b6f-af75-cc55766b7eae" status: 200 len: 1522 microversion: 2.1 time: 0.232496 Jul 18 10:30:34.340897 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 126/244] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:30:34 2022] GET /compute/v2.1/servers/591fab72-3729-4b6f-af75-cc55766b7eae => generated 1522 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:30:34.718517 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [req-52a25f7f-6649-412e-89e3-ceed001e3580 req-d3d3c151-dc14-4460-8c41-58b40e8b3972 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "437b80a6-6436-4f8a-be28-49c9cbde98a0", "name": "network-vif-plugged", "status": "completed", "tag": "ec69e42c-a16f-4d5d-9f66-84ab1ea7ce3c"}]} {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:30:34.735628 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [req-52a25f7f-6649-412e-89e3-ceed001e3580 req-d3d3c151-dc14-4460-8c41-58b40e8b3972 service nova] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:30:34.736886 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [req-52a25f7f-6649-412e-89e3-ceed001e3580 req-d3d3c151-dc14-4460-8c41-58b40e8b3972 service nova] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:30:34.751148 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.compute.server_external_events [req-52a25f7f-6649-412e-89e3-ceed001e3580 req-d3d3c151-dc14-4460-8c41-58b40e8b3972 service nova] Creating event network-vif-plugged:ec69e42c-a16f-4d5d-9f66-84ab1ea7ce3c for instance 437b80a6-6436-4f8a-be28-49c9cbde98a0 on hv-cinder-83754 Jul 18 10:30:34.758916 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [req-52a25f7f-6649-412e-89e3-ceed001e3580 req-d3d3c151-dc14-4460-8c41-58b40e8b3972 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044605 Jul 18 10:30:34.759959 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 119/245] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jul 18 10:30:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:30:35.351589 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-30b1afa4-4fea-46c7-aa42-66389c518e08 tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:30:35.351589 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-30b1afa4-4fea-46c7-aa42-66389c518e08 tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] [instance: 437b80a6-6436-4f8a-be28-49c9cbde98a0] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:30:35.357948 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-30b1afa4-4fea-46c7-aa42-66389c518e08 tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:30:35.358721 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-30b1afa4-4fea-46c7-aa42-66389c518e08 tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:30:35.359390 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-8b758e0e-a581-41fa-a260-80f087c262c8 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:30:35.359856 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-30b1afa4-4fea-46c7-aa42-66389c518e08 tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:30:35.360087 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-8b758e0e-a581-41fa-a260-80f087c262c8 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] [instance: 591fab72-3729-4b6f-af75-cc55766b7eae] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:30:35.360218 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-30b1afa4-4fea-46c7-aa42-66389c518e08 tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:30:35.367281 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-8b758e0e-a581-41fa-a260-80f087c262c8 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:30:35.368791 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-8b758e0e-a581-41fa-a260-80f087c262c8 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:30:35.370006 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-8b758e0e-a581-41fa-a260-80f087c262c8 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:30:35.370618 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-8b758e0e-a581-41fa-a260-80f087c262c8 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:30:35.845959 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-30b1afa4-4fea-46c7-aa42-66389c518e08 tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc233897770f47e5bd40fb03afabe49c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9698a0142f494095a93a4e804437bc32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:30:35.860813 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-30b1afa4-4fea-46c7-aa42-66389c518e08 tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] 10.222.0.33 "GET /compute/v2.1/servers/437b80a6-6436-4f8a-be28-49c9cbde98a0" status: 200 len: 1314 microversion: 2.1 time: 0.514138 Jul 18 10:30:35.862127 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 127/246] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:30:35 2022] GET /compute/v2.1/servers/437b80a6-6436-4f8a-be28-49c9cbde98a0 => generated 1314 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:30:35.876325 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-8b758e0e-a581-41fa-a260-80f087c262c8 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a431c9708f4694bc0d514133e76088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a1921237622439bab89676e11477c13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:30:35.886587 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-8b758e0e-a581-41fa-a260-80f087c262c8 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] 10.222.0.33 "GET /compute/v2.1/servers/591fab72-3729-4b6f-af75-cc55766b7eae" status: 200 len: 1522 microversion: 2.1 time: 0.532878 Jul 18 10:30:35.887240 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 120/247] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:30:35 2022] GET /compute/v2.1/servers/591fab72-3729-4b6f-af75-cc55766b7eae => generated 1522 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:30:36.879674 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-ee634f82-2c95-410f-a2c4-3febfc25f580 tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:30:36.881510 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-ee634f82-2c95-410f-a2c4-3febfc25f580 tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] [instance: 437b80a6-6436-4f8a-be28-49c9cbde98a0] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:30:36.889229 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-ee634f82-2c95-410f-a2c4-3febfc25f580 tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:30:36.889885 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-ee634f82-2c95-410f-a2c4-3febfc25f580 tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:30:36.890657 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-ee634f82-2c95-410f-a2c4-3febfc25f580 tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:30:36.891091 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-ee634f82-2c95-410f-a2c4-3febfc25f580 tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:30:36.903668 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-8f7a0a47-5286-4541-ab8c-7d1ca08eebc8 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:30:36.904654 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-8f7a0a47-5286-4541-ab8c-7d1ca08eebc8 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] [instance: 591fab72-3729-4b6f-af75-cc55766b7eae] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:30:36.911641 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-8f7a0a47-5286-4541-ab8c-7d1ca08eebc8 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:30:36.912207 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-8f7a0a47-5286-4541-ab8c-7d1ca08eebc8 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:30:36.913239 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-8f7a0a47-5286-4541-ab8c-7d1ca08eebc8 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:30:36.913885 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-8f7a0a47-5286-4541-ab8c-7d1ca08eebc8 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:30:37.154138 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-ee634f82-2c95-410f-a2c4-3febfc25f580 tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc233897770f47e5bd40fb03afabe49c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9698a0142f494095a93a4e804437bc32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:30:37.167220 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-ee634f82-2c95-410f-a2c4-3febfc25f580 tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] 10.222.0.33 "GET /compute/v2.1/servers/437b80a6-6436-4f8a-be28-49c9cbde98a0" status: 200 len: 1498 microversion: 2.1 time: 0.291899 Jul 18 10:30:37.168202 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 128/248] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:30:36 2022] GET /compute/v2.1/servers/437b80a6-6436-4f8a-be28-49c9cbde98a0 => generated 1498 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:30:37.180154 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-8f7a0a47-5286-4541-ab8c-7d1ca08eebc8 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a431c9708f4694bc0d514133e76088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a1921237622439bab89676e11477c13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:30:37.203770 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-8f7a0a47-5286-4541-ab8c-7d1ca08eebc8 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] 10.222.0.33 "GET /compute/v2.1/servers/591fab72-3729-4b6f-af75-cc55766b7eae" status: 200 len: 1522 microversion: 2.1 time: 0.303850 Jul 18 10:30:37.205061 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 121/249] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:30:36 2022] GET /compute/v2.1/servers/591fab72-3729-4b6f-af75-cc55766b7eae => generated 1522 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:30:37.338518 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-9e17b5d9-bb89-4337-b437-885d1dd6a56e tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:30:37.339820 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-9e17b5d9-bb89-4337-b437-885d1dd6a56e tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] [instance: dcb1b50b-9e62-4ff3-9875-3d4635597b45] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:30:37.349396 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-9e17b5d9-bb89-4337-b437-885d1dd6a56e tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:30:37.350083 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-9e17b5d9-bb89-4337-b437-885d1dd6a56e tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:30:37.351638 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-9e17b5d9-bb89-4337-b437-885d1dd6a56e tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:30:37.352360 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-9e17b5d9-bb89-4337-b437-885d1dd6a56e tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:30:37.379548 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-9e17b5d9-bb89-4337-b437-885d1dd6a56e tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] 10.222.0.33 "GET /compute/v2.1/servers/dcb1b50b-9e62-4ff3-9875-3d4635597b45/ips" status: 200 len: 145 microversion: 2.1 time: 0.045290 Jul 18 10:30:37.380162 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 129/250] 10.222.0.33 () {58 vars in 1247 bytes} [Mon Jul 18 10:30:37 2022] GET /compute/v2.1/servers/dcb1b50b-9e62-4ff3-9875-3d4635597b45/ips => generated 145 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:30:37.780359 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-cb11c027-154e-4270-95d7-46bdb2a633eb tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:30:37.780876 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-cb11c027-154e-4270-95d7-46bdb2a633eb tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] [instance: 437b80a6-6436-4f8a-be28-49c9cbde98a0] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:30:37.788931 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-cb11c027-154e-4270-95d7-46bdb2a633eb tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:30:37.789570 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-cb11c027-154e-4270-95d7-46bdb2a633eb tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:30:37.790367 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-cb11c027-154e-4270-95d7-46bdb2a633eb tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:30:37.790790 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-cb11c027-154e-4270-95d7-46bdb2a633eb tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:30:37.795361 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG dbcounter [-] [117880] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:30:37.826038 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-cb11c027-154e-4270-95d7-46bdb2a633eb tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] [instance: 437b80a6-6436-4f8a-be28-49c9cbde98a0] Going to try to terminate instance {{(pid=117880) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 10:30:37.936594 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-cb11c027-154e-4270-95d7-46bdb2a633eb tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] 10.222.0.33 "DELETE /compute/v2.1/servers/437b80a6-6436-4f8a-be28-49c9cbde98a0" status: 204 len: 0 microversion: 2.1 time: 0.160758 Jul 18 10:30:37.937774 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 122/251] 10.222.0.33 () {58 vars in 1238 bytes} [Mon Jul 18 10:30:37 2022] DELETE /compute/v2.1/servers/437b80a6-6436-4f8a-be28-49c9cbde98a0 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 10:30:37.949380 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-006a67ca-b1df-4be7-a72e-c2f1353a7080 tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:30:37.950071 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-006a67ca-b1df-4be7-a72e-c2f1353a7080 tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] [instance: 437b80a6-6436-4f8a-be28-49c9cbde98a0] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:30:37.958512 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-006a67ca-b1df-4be7-a72e-c2f1353a7080 tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:30:37.958512 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-006a67ca-b1df-4be7-a72e-c2f1353a7080 tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:30:37.958766 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-006a67ca-b1df-4be7-a72e-c2f1353a7080 tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:30:37.959110 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-006a67ca-b1df-4be7-a72e-c2f1353a7080 tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:30:38.126543 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-006a67ca-b1df-4be7-a72e-c2f1353a7080 tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc233897770f47e5bd40fb03afabe49c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9698a0142f494095a93a4e804437bc32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:30:38.140090 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-006a67ca-b1df-4be7-a72e-c2f1353a7080 tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] 10.222.0.33 "GET /compute/v2.1/servers/437b80a6-6436-4f8a-be28-49c9cbde98a0" status: 200 len: 1504 microversion: 2.1 time: 0.197644 Jul 18 10:30:38.142984 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 130/252] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:30:37 2022] GET /compute/v2.1/servers/437b80a6-6436-4f8a-be28-49c9cbde98a0 => generated 1504 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:30:38.224078 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-138e45b7-3f4c-4b8b-9ba9-f7fad463ade0 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:30:38.224727 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-138e45b7-3f4c-4b8b-9ba9-f7fad463ade0 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] [instance: 591fab72-3729-4b6f-af75-cc55766b7eae] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:30:38.233692 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-138e45b7-3f4c-4b8b-9ba9-f7fad463ade0 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:30:38.234266 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-138e45b7-3f4c-4b8b-9ba9-f7fad463ade0 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:30:38.235189 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-138e45b7-3f4c-4b8b-9ba9-f7fad463ade0 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:30:38.235628 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-138e45b7-3f4c-4b8b-9ba9-f7fad463ade0 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:30:38.404243 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-138e45b7-3f4c-4b8b-9ba9-f7fad463ade0 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a431c9708f4694bc0d514133e76088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a1921237622439bab89676e11477c13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:30:38.414867 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-138e45b7-3f4c-4b8b-9ba9-f7fad463ade0 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] 10.222.0.33 "GET /compute/v2.1/servers/591fab72-3729-4b6f-af75-cc55766b7eae" status: 200 len: 1522 microversion: 2.1 time: 0.196580 Jul 18 10:30:38.415513 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 123/253] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:30:38 2022] GET /compute/v2.1/servers/591fab72-3729-4b6f-af75-cc55766b7eae => generated 1522 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:30:39.160963 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-52dad0d7-3509-4654-9474-a2297b17c33a tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:30:39.161554 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-52dad0d7-3509-4654-9474-a2297b17c33a tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] [instance: 437b80a6-6436-4f8a-be28-49c9cbde98a0] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:30:39.168714 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-52dad0d7-3509-4654-9474-a2297b17c33a tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:30:39.169198 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-52dad0d7-3509-4654-9474-a2297b17c33a tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:30:39.169968 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-52dad0d7-3509-4654-9474-a2297b17c33a tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:30:39.170434 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-52dad0d7-3509-4654-9474-a2297b17c33a tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:30:39.307905 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-52dad0d7-3509-4654-9474-a2297b17c33a tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc233897770f47e5bd40fb03afabe49c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9698a0142f494095a93a4e804437bc32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:30:39.315601 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-52dad0d7-3509-4654-9474-a2297b17c33a tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] 10.222.0.33 "GET /compute/v2.1/servers/437b80a6-6436-4f8a-be28-49c9cbde98a0" status: 200 len: 1504 microversion: 2.1 time: 0.158541 Jul 18 10:30:39.316168 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 131/254] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:30:39 2022] GET /compute/v2.1/servers/437b80a6-6436-4f8a-be28-49c9cbde98a0 => generated 1504 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:30:39.432704 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-df163a02-3832-4154-8d4d-c5981337320b tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:30:39.433316 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-df163a02-3832-4154-8d4d-c5981337320b tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] [instance: 591fab72-3729-4b6f-af75-cc55766b7eae] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:30:39.442074 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-df163a02-3832-4154-8d4d-c5981337320b tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:30:39.447518 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-df163a02-3832-4154-8d4d-c5981337320b tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:30:39.448587 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-df163a02-3832-4154-8d4d-c5981337320b tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:30:39.449042 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-df163a02-3832-4154-8d4d-c5981337320b tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:30:39.609886 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-df163a02-3832-4154-8d4d-c5981337320b tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a431c9708f4694bc0d514133e76088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a1921237622439bab89676e11477c13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:30:39.619080 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-df163a02-3832-4154-8d4d-c5981337320b tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] 10.222.0.33 "GET /compute/v2.1/servers/591fab72-3729-4b6f-af75-cc55766b7eae" status: 200 len: 1522 microversion: 2.1 time: 0.190369 Jul 18 10:30:39.619650 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 124/255] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:30:39 2022] GET /compute/v2.1/servers/591fab72-3729-4b6f-af75-cc55766b7eae => generated 1522 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:30:40.333460 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-a88ed262-ffae-4d6b-889f-94a2b5ca33da tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:30:40.334077 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-a88ed262-ffae-4d6b-889f-94a2b5ca33da tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] [instance: 437b80a6-6436-4f8a-be28-49c9cbde98a0] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:30:40.341511 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-a88ed262-ffae-4d6b-889f-94a2b5ca33da tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:30:40.342035 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-a88ed262-ffae-4d6b-889f-94a2b5ca33da tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:30:40.342817 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-a88ed262-ffae-4d6b-889f-94a2b5ca33da tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:30:40.343422 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-a88ed262-ffae-4d6b-889f-94a2b5ca33da tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:30:40.382400 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [req-1f20ad1b-1bcd-4524-8be0-25537065b49a req-ad077e2e-958e-457a-9748-ee0b4cc2b7a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "437b80a6-6436-4f8a-be28-49c9cbde98a0", "name": "network-vif-deleted", "tag": "ec69e42c-a16f-4d5d-9f66-84ab1ea7ce3c"}]} {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:30:40.394957 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [req-1f20ad1b-1bcd-4524-8be0-25537065b49a req-ad077e2e-958e-457a-9748-ee0b4cc2b7a4 service nova] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:30:40.395421 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [req-1f20ad1b-1bcd-4524-8be0-25537065b49a req-ad077e2e-958e-457a-9748-ee0b4cc2b7a4 service nova] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:30:40.408761 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.compute.server_external_events [req-1f20ad1b-1bcd-4524-8be0-25537065b49a req-ad077e2e-958e-457a-9748-ee0b4cc2b7a4 service nova] Creating event network-vif-deleted:ec69e42c-a16f-4d5d-9f66-84ab1ea7ce3c for instance 437b80a6-6436-4f8a-be28-49c9cbde98a0 on hv-cinder-83754 Jul 18 10:30:40.417397 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [req-1f20ad1b-1bcd-4524-8be0-25537065b49a req-ad077e2e-958e-457a-9748-ee0b4cc2b7a4 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038691 Jul 18 10:30:40.418731 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 125/256] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jul 18 10:30:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 10:30:40.423690 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-a88ed262-ffae-4d6b-889f-94a2b5ca33da tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc233897770f47e5bd40fb03afabe49c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9698a0142f494095a93a4e804437bc32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:30:40.432271 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-a88ed262-ffae-4d6b-889f-94a2b5ca33da tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] 10.222.0.33 "GET /compute/v2.1/servers/437b80a6-6436-4f8a-be28-49c9cbde98a0" status: 200 len: 1462 microversion: 2.1 time: 0.104145 Jul 18 10:30:40.432968 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 132/257] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:30:40 2022] GET /compute/v2.1/servers/437b80a6-6436-4f8a-be28-49c9cbde98a0 => generated 1462 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:30:40.638635 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-b9556d27-404f-4677-94be-70b19fe48d10 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:30:40.639579 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-b9556d27-404f-4677-94be-70b19fe48d10 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] [instance: 591fab72-3729-4b6f-af75-cc55766b7eae] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:30:40.650055 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-b9556d27-404f-4677-94be-70b19fe48d10 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:30:40.650563 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-b9556d27-404f-4677-94be-70b19fe48d10 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:30:40.651418 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-b9556d27-404f-4677-94be-70b19fe48d10 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:30:40.651862 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-b9556d27-404f-4677-94be-70b19fe48d10 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:30:40.792854 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-b9556d27-404f-4677-94be-70b19fe48d10 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a431c9708f4694bc0d514133e76088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a1921237622439bab89676e11477c13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:30:40.802237 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-b9556d27-404f-4677-94be-70b19fe48d10 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] 10.222.0.33 "GET /compute/v2.1/servers/591fab72-3729-4b6f-af75-cc55766b7eae" status: 200 len: 1522 microversion: 2.1 time: 0.169024 Jul 18 10:30:40.802814 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 126/258] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:30:40 2022] GET /compute/v2.1/servers/591fab72-3729-4b6f-af75-cc55766b7eae => generated 1522 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:30:41.273622 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-7ae756d3-be7f-422c-be1a-e2ec7b1a5763 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:30:41.274206 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-7ae756d3-be7f-422c-be1a-e2ec7b1a5763 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] [instance: db62c05e-28a8-4121-a6e5-8abb802f7a17] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:30:41.280777 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-7ae756d3-be7f-422c-be1a-e2ec7b1a5763 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:30:41.281229 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-7ae756d3-be7f-422c-be1a-e2ec7b1a5763 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:30:41.282037 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-7ae756d3-be7f-422c-be1a-e2ec7b1a5763 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:30:41.282479 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-7ae756d3-be7f-422c-be1a-e2ec7b1a5763 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:30:41.309923 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-7ae756d3-be7f-422c-be1a-e2ec7b1a5763 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] 10.222.0.33 "GET /compute/v2.1/servers/db62c05e-28a8-4121-a6e5-8abb802f7a17/ips" status: 200 len: 151 microversion: 2.1 time: 0.040093 Jul 18 10:30:41.310793 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 133/259] 10.222.0.33 () {58 vars in 1247 bytes} [Mon Jul 18 10:30:41 2022] GET /compute/v2.1/servers/db62c05e-28a8-4121-a6e5-8abb802f7a17/ips => generated 151 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 10:30:41.451492 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-71b352c4-1d4b-4130-8319-ec2e9ce17b96 tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:30:41.452493 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-71b352c4-1d4b-4130-8319-ec2e9ce17b96 tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] [instance: 437b80a6-6436-4f8a-be28-49c9cbde98a0] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:30:41.467348 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-71b352c4-1d4b-4130-8319-ec2e9ce17b96 tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:30:41.467938 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-71b352c4-1d4b-4130-8319-ec2e9ce17b96 tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:30:41.469572 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-71b352c4-1d4b-4130-8319-ec2e9ce17b96 tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:30:41.470192 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-71b352c4-1d4b-4130-8319-ec2e9ce17b96 tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:30:41.495699 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.wsgi [None req-71b352c4-1d4b-4130-8319-ec2e9ce17b96 tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] HTTP exception thrown: Instance 437b80a6-6436-4f8a-be28-49c9cbde98a0 could not be found. Jul 18 10:30:41.507557 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-71b352c4-1d4b-4130-8319-ec2e9ce17b96 tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] Request method failure captured: Jul 18 10:30:41.507557 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: request: GET /compute/v2.1/servers/437b80a6-6436-4f8a-be28-49c9cbde98a0 HTTP/1.1 Jul 18 10:30:41.507557 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: Accept: application/json Jul 18 10:30:41.507557 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: Accept-Encoding: identity Jul 18 10:30:41.507557 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: Connection: close Jul 18 10:30:41.507557 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: Content-Length: 0 Jul 18 10:30:41.507557 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: Content-Type: application/json Jul 18 10:30:41.507557 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: Host: 10.222.0.33 Jul 18 10:30:41.507557 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: Openstack-System-Scope: None Jul 18 10:30:41.507557 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: User-Agent: python-urllib3/1.26.9 Jul 18 10:30:41.507557 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Auth-Token: gAAAAABi1TYdXC6eZriRiBXG35R4hZD1rF2BwxNODfLGSzKLogF9euSiBFxhSGCfUCffx2FhgLl_pvVS_LFmCEWVFzUwtZd5Xi5_85-W9ZLsIZ8G7cQIqC3D-QNelFOqyAx1nLcyIWbMcFK9YWfSKQSAdwTZwQdp0HvQhbxRin0aS98jXN3OCDQ Jul 18 10:30:41.507557 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Domain-Id: None Jul 18 10:30:41.507557 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Domain-Name: None Jul 18 10:30:41.507557 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Identity-Status: Confirmed Jul 18 10:30:41.507557 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Is-Admin-Project: True Jul 18 10:30:41.507557 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Project-Domain-Id: default Jul 18 10:30:41.507557 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Project-Domain-Name: Default Jul 18 10:30:41.507557 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Project-Id: 9698a0142f494095a93a4e804437bc32 Jul 18 10:30:41.507557 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Project-Name: tempest-VolumesActionsTest-1071066098 Jul 18 10:30:41.507557 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Role: member,reader Jul 18 10:30:41.507557 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Roles: member,reader Jul 18 10:30:41.508760 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/9698a0142f494095a93a4e804437bc32"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/9698a0142f494095a93a4e804437bc32"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/9698a0142f494095a93a4e804437bc32"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_9698a0142f494095a93a4e804437bc32"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jul 18 10:30:41.508760 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Tenant: tempest-VolumesActionsTest-1071066098 Jul 18 10:30:41.508760 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Tenant-Id: 9698a0142f494095a93a4e804437bc32 Jul 18 10:30:41.508760 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Tenant-Name: tempest-VolumesActionsTest-1071066098 Jul 18 10:30:41.508760 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-User: tempest-VolumesActionsTest-1071066098-project Jul 18 10:30:41.508760 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-User-Domain-Id: default Jul 18 10:30:41.508760 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-User-Domain-Name: Default Jul 18 10:30:41.508760 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-User-Id: bc233897770f47e5bd40fb03afabe49c Jul 18 10:30:41.508760 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-User-Name: tempest-VolumesActionsTest-1071066098-project Jul 18 10:30:41.508760 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: method: > Jul 18 10:30:41.508760 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: exception: Instance 437b80a6-6436-4f8a-be28-49c9cbde98a0 could not be found. Jul 18 10:30:41.508760 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: action_args: {'id': '437b80a6-6436-4f8a-be28-49c9cbde98a0'} Jul 18 10:30:41.509821 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 10:30:41.509821 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:30:41.509821 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 10:30:41.509821 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 10:30:41.509821 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 10:30:41.509821 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 10:30:41.509821 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 10:30:41.509821 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 10:30:41.509821 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 10:30:41.509821 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 10:30:41.509821 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 437b80a6-6436-4f8a-be28-49c9cbde98a0 could not be found. Jul 18 10:30:41.509821 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi Jul 18 10:30:41.509821 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:30:41.509821 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi Jul 18 10:30:41.509821 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:30:41.509821 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:30:41.509821 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:30:41.509821 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 10:30:41.509821 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 10:30:41.509821 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 10:30:41.511179 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 10:30:41.511179 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 10:30:41.511179 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 10:30:41.511179 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 10:30:41.511179 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 10:30:41.511179 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 10:30:41.511179 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 10:30:41.511179 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 437b80a6-6436-4f8a-be28-49c9cbde98a0 could not be found. Jul 18 10:30:41.511179 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi Jul 18 10:30:41.511179 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:30:41.511179 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi Jul 18 10:30:41.511179 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:30:41.511179 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:30:41.511179 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:30:41.511179 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 10:30:41.511179 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 10:30:41.511179 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 437b80a6-6436-4f8a-be28-49c9cbde98a0 could not be found. Jul 18 10:30:41.511179 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi Jul 18 10:30:41.514137 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-71b352c4-1d4b-4130-8319-ec2e9ce17b96 tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] Returning 404 to user: Instance 437b80a6-6436-4f8a-be28-49c9cbde98a0 could not be found. {{(pid=117880) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 10:30:41.514137 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-71b352c4-1d4b-4130-8319-ec2e9ce17b96 tempest-VolumesActionsTest-1071066098 tempest-VolumesActionsTest-1071066098-project] 10.222.0.33 "GET /compute/v2.1/servers/437b80a6-6436-4f8a-be28-49c9cbde98a0" status: 404 len: 111 microversion: 2.1 time: 0.059261 Jul 18 10:30:41.514137 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 127/260] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:30:41 2022] GET /compute/v2.1/servers/437b80a6-6436-4f8a-be28-49c9cbde98a0 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 10:30:41.823627 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-d1b840e8-5774-459e-a194-682fe2407c50 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:30:41.827951 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-d1b840e8-5774-459e-a194-682fe2407c50 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] [instance: 591fab72-3729-4b6f-af75-cc55766b7eae] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:30:41.838495 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-d1b840e8-5774-459e-a194-682fe2407c50 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:30:41.839297 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-d1b840e8-5774-459e-a194-682fe2407c50 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:30:41.840291 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-d1b840e8-5774-459e-a194-682fe2407c50 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:30:41.841263 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-d1b840e8-5774-459e-a194-682fe2407c50 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:30:42.165250 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-d1b840e8-5774-459e-a194-682fe2407c50 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a431c9708f4694bc0d514133e76088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a1921237622439bab89676e11477c13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:30:42.168836 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG dbcounter [-] [117879] Writing DB stats nova_cell1:SELECT=100 {{(pid=117879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:30:42.176389 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-d1b840e8-5774-459e-a194-682fe2407c50 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] 10.222.0.33 "GET /compute/v2.1/servers/591fab72-3729-4b6f-af75-cc55766b7eae" status: 200 len: 1522 microversion: 2.1 time: 0.360989 Jul 18 10:30:42.177016 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 134/261] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:30:41 2022] GET /compute/v2.1/servers/591fab72-3729-4b6f-af75-cc55766b7eae => generated 1522 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:30:42.932374 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-3e7d5e46-e370-4ea4-a1c9-f3f48d6f5966 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a7283353-c48b-45f2-9b6f-aede9fbb96b4"}} {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:30:42.933971 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-3e7d5e46-e370-4ea4-a1c9-f3f48d6f5966 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] [instance: db62c05e-28a8-4121-a6e5-8abb802f7a17] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:30:42.940969 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-3e7d5e46-e370-4ea4-a1c9-f3f48d6f5966 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:30:42.941418 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-3e7d5e46-e370-4ea4-a1c9-f3f48d6f5966 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:30:42.942191 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-3e7d5e46-e370-4ea4-a1c9-f3f48d6f5966 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:30:42.942742 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-3e7d5e46-e370-4ea4-a1c9-f3f48d6f5966 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:30:43.131651 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-dc4654f5-c979-4469-9408-29e15b80d047 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e3719658-555b-4733-b61e-334384f6186d"}} {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:30:43.132950 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-dc4654f5-c979-4469-9408-29e15b80d047 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] [instance: dcb1b50b-9e62-4ff3-9875-3d4635597b45] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:30:43.143228 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-dc4654f5-c979-4469-9408-29e15b80d047 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:30:43.143843 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-dc4654f5-c979-4469-9408-29e15b80d047 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:30:43.145905 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-dc4654f5-c979-4469-9408-29e15b80d047 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:30:43.147113 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-dc4654f5-c979-4469-9408-29e15b80d047 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:30:43.294677 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-3e7d5e46-e370-4ea4-a1c9-f3f48d6f5966 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] 10.222.0.33 "POST /compute/v2.1/servers/db62c05e-28a8-4121-a6e5-8abb802f7a17/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.368101 Jul 18 10:30:43.295504 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 128/262] 10.222.0.33 () {60 vars in 1322 bytes} [Mon Jul 18 10:30:42 2022] POST /compute/v2.1/servers/db62c05e-28a8-4121-a6e5-8abb802f7a17/os-volume_attachments => generated 194 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:30:43.313566 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-66239182-4262-4a23-b3fd-72aaadc07411 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:30:43.314883 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-66239182-4262-4a23-b3fd-72aaadc07411 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] [instance: 591fab72-3729-4b6f-af75-cc55766b7eae] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:30:43.347485 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-66239182-4262-4a23-b3fd-72aaadc07411 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:30:43.349526 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-66239182-4262-4a23-b3fd-72aaadc07411 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:30:43.352864 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-66239182-4262-4a23-b3fd-72aaadc07411 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:30:43.353625 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-66239182-4262-4a23-b3fd-72aaadc07411 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:30:43.517701 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-66239182-4262-4a23-b3fd-72aaadc07411 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a431c9708f4694bc0d514133e76088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a1921237622439bab89676e11477c13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:30:43.525226 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-66239182-4262-4a23-b3fd-72aaadc07411 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] 10.222.0.33 "GET /compute/v2.1/servers/591fab72-3729-4b6f-af75-cc55766b7eae" status: 200 len: 1522 microversion: 2.1 time: 0.228408 Jul 18 10:30:43.525946 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 129/263] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:30:43 2022] GET /compute/v2.1/servers/591fab72-3729-4b6f-af75-cc55766b7eae => generated 1522 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:30:44.542787 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-61f2f7f2-606f-4aae-b256-63db5f35c5b9 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:30:44.543433 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-61f2f7f2-606f-4aae-b256-63db5f35c5b9 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] [instance: 591fab72-3729-4b6f-af75-cc55766b7eae] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:30:44.550100 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-61f2f7f2-606f-4aae-b256-63db5f35c5b9 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:30:44.550551 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-61f2f7f2-606f-4aae-b256-63db5f35c5b9 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:30:44.551313 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-61f2f7f2-606f-4aae-b256-63db5f35c5b9 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:30:44.551767 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-61f2f7f2-606f-4aae-b256-63db5f35c5b9 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:30:44.686065 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-61f2f7f2-606f-4aae-b256-63db5f35c5b9 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a431c9708f4694bc0d514133e76088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a1921237622439bab89676e11477c13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:30:44.696553 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-61f2f7f2-606f-4aae-b256-63db5f35c5b9 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] 10.222.0.33 "GET /compute/v2.1/servers/591fab72-3729-4b6f-af75-cc55766b7eae" status: 200 len: 1522 microversion: 2.1 time: 0.157643 Jul 18 10:30:44.697124 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 130/264] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:30:44 2022] GET /compute/v2.1/servers/591fab72-3729-4b6f-af75-cc55766b7eae => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:30:45.714119 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-77bc2786-9917-4e4c-9324-4217ed957560 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:30:45.714718 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-77bc2786-9917-4e4c-9324-4217ed957560 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] [instance: 591fab72-3729-4b6f-af75-cc55766b7eae] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:30:45.721624 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-77bc2786-9917-4e4c-9324-4217ed957560 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:30:45.722062 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-77bc2786-9917-4e4c-9324-4217ed957560 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:30:45.722808 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-77bc2786-9917-4e4c-9324-4217ed957560 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:30:45.723235 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-77bc2786-9917-4e4c-9324-4217ed957560 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:30:45.847304 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-77bc2786-9917-4e4c-9324-4217ed957560 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a431c9708f4694bc0d514133e76088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a1921237622439bab89676e11477c13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:30:45.857519 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-77bc2786-9917-4e4c-9324-4217ed957560 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] 10.222.0.33 "GET /compute/v2.1/servers/591fab72-3729-4b6f-af75-cc55766b7eae" status: 200 len: 1522 microversion: 2.1 time: 0.147196 Jul 18 10:30:45.858077 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 131/265] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:30:45 2022] GET /compute/v2.1/servers/591fab72-3729-4b6f-af75-cc55766b7eae => generated 1522 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:30:46.095638 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-dc4654f5-c979-4469-9408-29e15b80d047 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] 10.222.0.33 "POST /compute/v2.1/servers/dcb1b50b-9e62-4ff3-9875-3d4635597b45/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.973325 Jul 18 10:30:46.100929 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 135/266] 10.222.0.33 () {60 vars in 1322 bytes} [Mon Jul 18 10:30:43 2022] POST /compute/v2.1/servers/dcb1b50b-9e62-4ff3-9875-3d4635597b45/os-volume_attachments => generated 194 bytes in 2975 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 10:30:46.879238 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-b7443dcd-08d5-4629-ada6-c1e5cb49c062 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:30:46.879847 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-b7443dcd-08d5-4629-ada6-c1e5cb49c062 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] [instance: 591fab72-3729-4b6f-af75-cc55766b7eae] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:30:46.886230 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-b7443dcd-08d5-4629-ada6-c1e5cb49c062 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:30:46.886681 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-b7443dcd-08d5-4629-ada6-c1e5cb49c062 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:30:46.887450 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-b7443dcd-08d5-4629-ada6-c1e5cb49c062 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:30:46.887882 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-b7443dcd-08d5-4629-ada6-c1e5cb49c062 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:30:47.019878 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-b7443dcd-08d5-4629-ada6-c1e5cb49c062 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a431c9708f4694bc0d514133e76088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a1921237622439bab89676e11477c13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:30:47.027640 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-b7443dcd-08d5-4629-ada6-c1e5cb49c062 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] 10.222.0.33 "GET /compute/v2.1/servers/591fab72-3729-4b6f-af75-cc55766b7eae" status: 200 len: 1522 microversion: 2.1 time: 0.152416 Jul 18 10:30:47.028211 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 132/267] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:30:46 2022] GET /compute/v2.1/servers/591fab72-3729-4b6f-af75-cc55766b7eae => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:30:48.046883 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-be0e03b2-10ce-4787-add5-c60db0829dc3 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:30:48.047610 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-be0e03b2-10ce-4787-add5-c60db0829dc3 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] [instance: 591fab72-3729-4b6f-af75-cc55766b7eae] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:30:48.049652 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG dbcounter [-] [117879] Writing DB stats nova_api:SELECT=60 {{(pid=117879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:30:48.056115 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-be0e03b2-10ce-4787-add5-c60db0829dc3 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:30:48.056712 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-be0e03b2-10ce-4787-add5-c60db0829dc3 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:30:48.058028 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-be0e03b2-10ce-4787-add5-c60db0829dc3 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:30:48.058476 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-be0e03b2-10ce-4787-add5-c60db0829dc3 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:30:48.200549 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-be0e03b2-10ce-4787-add5-c60db0829dc3 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a431c9708f4694bc0d514133e76088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a1921237622439bab89676e11477c13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:30:48.209006 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-be0e03b2-10ce-4787-add5-c60db0829dc3 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] 10.222.0.33 "GET /compute/v2.1/servers/591fab72-3729-4b6f-af75-cc55766b7eae" status: 200 len: 1522 microversion: 2.1 time: 0.167469 Jul 18 10:30:48.210218 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 136/268] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:30:48 2022] GET /compute/v2.1/servers/591fab72-3729-4b6f-af75-cc55766b7eae => generated 1522 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:30:49.226783 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-b29be482-3aae-4e72-89c3-bb94aeff0d30 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:30:49.227652 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-b29be482-3aae-4e72-89c3-bb94aeff0d30 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] [instance: 591fab72-3729-4b6f-af75-cc55766b7eae] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:30:49.236470 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-b29be482-3aae-4e72-89c3-bb94aeff0d30 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:30:49.237321 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-b29be482-3aae-4e72-89c3-bb94aeff0d30 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:30:49.238102 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-b29be482-3aae-4e72-89c3-bb94aeff0d30 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:30:49.238727 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-b29be482-3aae-4e72-89c3-bb94aeff0d30 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:30:49.577326 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-b29be482-3aae-4e72-89c3-bb94aeff0d30 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a431c9708f4694bc0d514133e76088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a1921237622439bab89676e11477c13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:30:49.587900 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-b29be482-3aae-4e72-89c3-bb94aeff0d30 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] 10.222.0.33 "GET /compute/v2.1/servers/591fab72-3729-4b6f-af75-cc55766b7eae" status: 200 len: 1522 microversion: 2.1 time: 0.364847 Jul 18 10:30:49.588479 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 133/269] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:30:49 2022] GET /compute/v2.1/servers/591fab72-3729-4b6f-af75-cc55766b7eae => generated 1522 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:30:50.605578 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-517caf56-5859-4aec-97e8-22fa5718bb59 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:30:50.606293 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-517caf56-5859-4aec-97e8-22fa5718bb59 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] [instance: 591fab72-3729-4b6f-af75-cc55766b7eae] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:30:50.614599 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-517caf56-5859-4aec-97e8-22fa5718bb59 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:30:50.615982 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-517caf56-5859-4aec-97e8-22fa5718bb59 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:30:50.619196 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-517caf56-5859-4aec-97e8-22fa5718bb59 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:30:50.619813 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-517caf56-5859-4aec-97e8-22fa5718bb59 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:30:50.792377 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-517caf56-5859-4aec-97e8-22fa5718bb59 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a431c9708f4694bc0d514133e76088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a1921237622439bab89676e11477c13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:30:50.805425 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-517caf56-5859-4aec-97e8-22fa5718bb59 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] 10.222.0.33 "GET /compute/v2.1/servers/591fab72-3729-4b6f-af75-cc55766b7eae" status: 200 len: 1522 microversion: 2.1 time: 0.204078 Jul 18 10:30:50.806581 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 137/270] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:30:50 2022] GET /compute/v2.1/servers/591fab72-3729-4b6f-af75-cc55766b7eae => generated 1522 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:30:50.914376 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-8994dd73-322f-4248-80ba-20c57794947d tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "78c1430f-3781-4dff-ab55-f00da164f906", "device": "/dev/sdb"}} {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:30:50.916009 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-8994dd73-322f-4248-80ba-20c57794947d tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] [instance: 233328a3-8e4b-4ece-8072-1a31d00d730f] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:30:50.924859 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-8994dd73-322f-4248-80ba-20c57794947d tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:30:50.925391 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-8994dd73-322f-4248-80ba-20c57794947d tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:30:50.926238 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-8994dd73-322f-4248-80ba-20c57794947d tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:30:50.926739 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-8994dd73-322f-4248-80ba-20c57794947d tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:30:51.614138 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-8994dd73-322f-4248-80ba-20c57794947d tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] 10.222.0.33 "POST /compute/v2.1/servers/233328a3-8e4b-4ece-8072-1a31d00d730f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.702621 Jul 18 10:30:51.620858 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 134/271] 10.222.0.33 () {60 vars in 1322 bytes} [Mon Jul 18 10:30:50 2022] POST /compute/v2.1/servers/233328a3-8e4b-4ece-8072-1a31d00d730f/os-volume_attachments => generated 194 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:30:51.823891 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-8eda75bf-6a6a-448b-8bbb-cde978e36c4b tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:30:51.824486 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-8eda75bf-6a6a-448b-8bbb-cde978e36c4b tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] [instance: 591fab72-3729-4b6f-af75-cc55766b7eae] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:30:51.832997 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-8eda75bf-6a6a-448b-8bbb-cde978e36c4b tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:30:51.837323 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-8eda75bf-6a6a-448b-8bbb-cde978e36c4b tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:30:51.838163 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-8eda75bf-6a6a-448b-8bbb-cde978e36c4b tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:30:51.838604 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-8eda75bf-6a6a-448b-8bbb-cde978e36c4b tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:30:52.073164 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-8eda75bf-6a6a-448b-8bbb-cde978e36c4b tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a431c9708f4694bc0d514133e76088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a1921237622439bab89676e11477c13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:30:52.082124 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-8eda75bf-6a6a-448b-8bbb-cde978e36c4b tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] 10.222.0.33 "GET /compute/v2.1/servers/591fab72-3729-4b6f-af75-cc55766b7eae" status: 200 len: 1522 microversion: 2.1 time: 0.262703 Jul 18 10:30:52.082699 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 138/272] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:30:51 2022] GET /compute/v2.1/servers/591fab72-3729-4b6f-af75-cc55766b7eae => generated 1522 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:30:53.101678 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-791f4e8a-8e15-4781-bf95-ddeb57f00a22 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:30:53.104693 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-791f4e8a-8e15-4781-bf95-ddeb57f00a22 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] [instance: 591fab72-3729-4b6f-af75-cc55766b7eae] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:30:53.130784 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-791f4e8a-8e15-4781-bf95-ddeb57f00a22 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:30:53.133197 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-791f4e8a-8e15-4781-bf95-ddeb57f00a22 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:30:53.137950 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-791f4e8a-8e15-4781-bf95-ddeb57f00a22 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:30:53.139253 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-791f4e8a-8e15-4781-bf95-ddeb57f00a22 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:30:53.403196 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-791f4e8a-8e15-4781-bf95-ddeb57f00a22 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a431c9708f4694bc0d514133e76088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a1921237622439bab89676e11477c13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:30:53.409557 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG dbcounter [-] [117880] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=117880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:30:53.418767 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-791f4e8a-8e15-4781-bf95-ddeb57f00a22 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] 10.222.0.33 "GET /compute/v2.1/servers/591fab72-3729-4b6f-af75-cc55766b7eae" status: 200 len: 1522 microversion: 2.1 time: 0.322707 Jul 18 10:30:53.424488 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 135/273] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:30:53 2022] GET /compute/v2.1/servers/591fab72-3729-4b6f-af75-cc55766b7eae => generated 1522 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:30:54.453186 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-9ba7e202-024b-4dba-94b8-1bb8049c1ece tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:30:54.454566 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-9ba7e202-024b-4dba-94b8-1bb8049c1ece tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] [instance: 591fab72-3729-4b6f-af75-cc55766b7eae] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:30:54.464222 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-9ba7e202-024b-4dba-94b8-1bb8049c1ece tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:30:54.465213 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-9ba7e202-024b-4dba-94b8-1bb8049c1ece tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:30:54.466356 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-9ba7e202-024b-4dba-94b8-1bb8049c1ece tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:30:54.466953 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-9ba7e202-024b-4dba-94b8-1bb8049c1ece tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:30:54.662236 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-9ba7e202-024b-4dba-94b8-1bb8049c1ece tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a431c9708f4694bc0d514133e76088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a1921237622439bab89676e11477c13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:30:54.673275 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-9ba7e202-024b-4dba-94b8-1bb8049c1ece tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] 10.222.0.33 "GET /compute/v2.1/servers/591fab72-3729-4b6f-af75-cc55766b7eae" status: 200 len: 1502 microversion: 2.1 time: 0.225715 Jul 18 10:30:54.674004 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 139/274] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:30:54 2022] GET /compute/v2.1/servers/591fab72-3729-4b6f-af75-cc55766b7eae => generated 1502 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:30:54.694702 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-458a6795-bcbf-454f-b29e-9343d199cf8d tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3c7841c9-f409-4be0-95cd-fc5310a145aa"}} {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:30:54.698229 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-458a6795-bcbf-454f-b29e-9343d199cf8d tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] [instance: 591fab72-3729-4b6f-af75-cc55766b7eae] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:30:54.709405 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-458a6795-bcbf-454f-b29e-9343d199cf8d tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:30:54.709851 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-458a6795-bcbf-454f-b29e-9343d199cf8d tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:30:54.711843 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-458a6795-bcbf-454f-b29e-9343d199cf8d tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:30:54.712443 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-458a6795-bcbf-454f-b29e-9343d199cf8d tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:30:54.756959 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.wsgi [None req-458a6795-bcbf-454f-b29e-9343d199cf8d tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] HTTP exception thrown: Cannot 'attach_volume' instance 591fab72-3729-4b6f-af75-cc55766b7eae while it is in vm_state rescued Jul 18 10:30:54.759243 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-458a6795-bcbf-454f-b29e-9343d199cf8d tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Request method failure captured: Jul 18 10:30:54.759243 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: request: POST /compute/v2.1/servers/591fab72-3729-4b6f-af75-cc55766b7eae/os-volume_attachments HTTP/1.1 Jul 18 10:30:54.759243 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: Accept: application/json Jul 18 10:30:54.759243 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: Accept-Encoding: identity Jul 18 10:30:54.759243 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: Connection: close Jul 18 10:30:54.759243 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: Content-Length: 74 Jul 18 10:30:54.759243 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: Content-Type: application/json Jul 18 10:30:54.759243 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: Host: 10.222.0.33 Jul 18 10:30:54.759243 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: Openstack-System-Scope: None Jul 18 10:30:54.759243 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: User-Agent: python-urllib3/1.26.9 Jul 18 10:30:54.759243 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Auth-Token: gAAAAABi1TXwn_mK_f7kuXECN8SGyXeI6MkiVur1cBGu0x9uwAf9xlFmP_-pUfPg46JxcRhK0sdtXAw2aOkGpoBZqQnqLV_xkZTvI1OQD5pPdoysYJdyciJL2bXUdpnFbLgqC6bxNJTUhgXK9B7t-8gSneKlpBB0M32nX-UxxWq_GmI2i5lMPM8 Jul 18 10:30:54.759243 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Domain-Id: None Jul 18 10:30:54.759243 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Domain-Name: None Jul 18 10:30:54.759243 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Identity-Status: Confirmed Jul 18 10:30:54.759243 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Is-Admin-Project: True Jul 18 10:30:54.759243 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Project-Domain-Id: default Jul 18 10:30:54.759243 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Project-Domain-Name: Default Jul 18 10:30:54.759243 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Project-Id: 8a1921237622439bab89676e11477c13 Jul 18 10:30:54.759243 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-33766307 Jul 18 10:30:54.759243 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Role: member,reader Jul 18 10:30:54.759243 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Roles: member,reader Jul 18 10:30:54.760447 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8a1921237622439bab89676e11477c13"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8a1921237622439bab89676e11477c13"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/8a1921237622439bab89676e11477c13"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_8a1921237622439bab89676e11477c13"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jul 18 10:30:54.760447 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Tenant: tempest-ServerRescueNegativeTestJSON-33766307 Jul 18 10:30:54.760447 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Tenant-Id: 8a1921237622439bab89676e11477c13 Jul 18 10:30:54.760447 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-33766307 Jul 18 10:30:54.760447 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-User: tempest-ServerRescueNegativeTestJSON-33766307-project Jul 18 10:30:54.760447 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-User-Domain-Id: default Jul 18 10:30:54.760447 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-User-Domain-Name: Default Jul 18 10:30:54.760447 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-User-Id: 72a431c9708f4694bc0d514133e76088 Jul 18 10:30:54.760447 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-User-Name: tempest-ServerRescueNegativeTestJSON-33766307-project Jul 18 10:30:54.760447 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: Jul 18 10:30:54.760447 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: {"volumeAttachment": {"volumeId": "3c7841c9-f409-4be0-95cd-fc5310a145aa"}} Jul 18 10:30:54.760447 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: method: > Jul 18 10:30:54.764683 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: exception: Cannot 'attach_volume' instance 591fab72-3729-4b6f-af75-cc55766b7eae while it is in vm_state rescued Jul 18 10:30:54.764683 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: action_args: {'server_id': '591fab72-3729-4b6f-af75-cc55766b7eae', 'body': {'volumeAttachment': {'volumeId': '3c7841c9-f409-4be0-95cd-fc5310a145aa'}}} Jul 18 10:30:54.764683 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 10:30:54.764683 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:30:54.764683 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 18 10:30:54.764683 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 18 10:30:54.764683 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 18 10:30:54.764683 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 18 10:30:54.764683 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 18 10:30:54.764683 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 18 10:30:54.764683 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 591fab72-3729-4b6f-af75-cc55766b7eae in vm_state rescued. Cannot attach_volume while the instance is in this state. Jul 18 10:30:54.764683 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi Jul 18 10:30:54.764683 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:30:54.764683 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi Jul 18 10:30:54.764683 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:30:54.764683 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:30:54.764683 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:30:54.764683 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 10:30:54.764683 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 10:30:54.766204 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 10:30:54.766204 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 10:30:54.766204 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 10:30:54.766204 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 10:30:54.766204 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 10:30:54.766204 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 10:30:54.766204 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 10:30:54.766204 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 10:30:54.766204 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jul 18 10:30:54.766204 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 18 10:30:54.766204 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 18 10:30:54.766204 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 18 10:30:54.766204 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 591fab72-3729-4b6f-af75-cc55766b7eae while it is in vm_state rescued Jul 18 10:30:54.766204 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi Jul 18 10:30:54.766204 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:30:54.766204 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi Jul 18 10:30:54.766204 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:30:54.766204 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:30:54.766204 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:30:54.767367 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 10:30:54.767367 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 10:30:54.767367 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 591fab72-3729-4b6f-af75-cc55766b7eae while it is in vm_state rescued Jul 18 10:30:54.767367 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi Jul 18 10:30:54.767367 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-458a6795-bcbf-454f-b29e-9343d199cf8d tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Returning 409 to user: Cannot 'attach_volume' instance 591fab72-3729-4b6f-af75-cc55766b7eae while it is in vm_state rescued {{(pid=117880) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 10:30:54.767367 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-458a6795-bcbf-454f-b29e-9343d199cf8d tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] 10.222.0.33 "POST /compute/v2.1/servers/591fab72-3729-4b6f-af75-cc55766b7eae/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.074800 Jul 18 10:30:54.767367 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 136/275] 10.222.0.33 () {60 vars in 1322 bytes} [Mon Jul 18 10:30:54 2022] POST /compute/v2.1/servers/591fab72-3729-4b6f-af75-cc55766b7eae/os-volume_attachments => generated 152 bytes in 76 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 18 10:30:54.771946 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-7e7fd352-588f-40c4-a5e0-0a02a48747e0 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:30:54.772684 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-7e7fd352-588f-40c4-a5e0-0a02a48747e0 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] [instance: 591fab72-3729-4b6f-af75-cc55766b7eae] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:30:54.781901 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-7e7fd352-588f-40c4-a5e0-0a02a48747e0 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:30:54.782330 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-7e7fd352-588f-40c4-a5e0-0a02a48747e0 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:30:54.783417 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-7e7fd352-588f-40c4-a5e0-0a02a48747e0 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:30:54.784776 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-7e7fd352-588f-40c4-a5e0-0a02a48747e0 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:30:55.050305 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-7e7fd352-588f-40c4-a5e0-0a02a48747e0 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] 10.222.0.33 "POST /compute/v2.1/servers/591fab72-3729-4b6f-af75-cc55766b7eae/action" status: 202 len: 0 microversion: 2.1 time: 0.283048 Jul 18 10:30:55.051878 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 140/276] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Jul 18 10:30:54 2022] POST /compute/v2.1/servers/591fab72-3729-4b6f-af75-cc55766b7eae/action => generated 0 bytes in 286 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 10:30:55.062471 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-e9cf6975-9cc6-4e94-9771-e6ba474cd8fc tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:30:55.063462 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-e9cf6975-9cc6-4e94-9771-e6ba474cd8fc tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] [instance: 591fab72-3729-4b6f-af75-cc55766b7eae] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:30:55.073293 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-e9cf6975-9cc6-4e94-9771-e6ba474cd8fc tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:30:55.074967 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-e9cf6975-9cc6-4e94-9771-e6ba474cd8fc tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:30:55.076180 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-e9cf6975-9cc6-4e94-9771-e6ba474cd8fc tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:30:55.076867 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-e9cf6975-9cc6-4e94-9771-e6ba474cd8fc tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:30:55.441877 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-c488331a-c442-4e38-91d7-4e3bdc5c2661 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Action: 'create', calling method: .version_select at 0x7f9f4a9f6790>, body: {"keypair": {"name": "tempest-keypair-1607051564", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDiIOVKpV1iPciccFFlDsqghQJ5+b7rjsABg1kwVJGxhpVwBZD93szxQ/ccNONu2NLWKjFlQpK68evmDx/J7H8FTPLH+McNVnKVENSYif9ms8oQ8oHtTyfIw45VPuWga9g=="}} {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:30:55.466457 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.quota [None req-c488331a-c442-4e38-91d7-4e3bdc5c2661 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Getting quotas for project 1cf3d5bfe9a745f38372c42c9cfa1f63. Resources: {'key_pairs'} {{(pid=117879) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 10:30:55.471773 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.quota [None req-c488331a-c442-4e38-91d7-4e3bdc5c2661 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Getting quotas for user f25c72896a2d4d619e5ad4b5a0a79aa6 and project 1cf3d5bfe9a745f38372c42c9cfa1f63. Resources: {'key_pairs'} {{(pid=117879) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 10:30:55.510345 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-e9cf6975-9cc6-4e94-9771-e6ba474cd8fc tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a431c9708f4694bc0d514133e76088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a1921237622439bab89676e11477c13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:30:55.522896 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-e9cf6975-9cc6-4e94-9771-e6ba474cd8fc tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] 10.222.0.33 "GET /compute/v2.1/servers/591fab72-3729-4b6f-af75-cc55766b7eae" status: 200 len: 1510 microversion: 2.1 time: 0.466330 Jul 18 10:30:55.524399 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 137/277] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:30:55 2022] GET /compute/v2.1/servers/591fab72-3729-4b6f-af75-cc55766b7eae => generated 1510 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:30:55.541789 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-c488331a-c442-4e38-91d7-4e3bdc5c2661 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.104149 Jul 18 10:30:55.543077 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 141/278] 10.222.0.33 () {60 vars in 1158 bytes} [Mon Jul 18 10:30:55 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:30:56.547326 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-96319e39-5d40-40e2-93c3-dbbe4bb6b6b3 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:30:56.549026 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-96319e39-5d40-40e2-93c3-dbbe4bb6b6b3 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] [instance: 591fab72-3729-4b6f-af75-cc55766b7eae] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:30:56.566149 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-96319e39-5d40-40e2-93c3-dbbe4bb6b6b3 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:30:56.566972 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-96319e39-5d40-40e2-93c3-dbbe4bb6b6b3 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:30:56.570964 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-96319e39-5d40-40e2-93c3-dbbe4bb6b6b3 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:30:56.571690 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-96319e39-5d40-40e2-93c3-dbbe4bb6b6b3 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:30:56.762006 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-96319e39-5d40-40e2-93c3-dbbe4bb6b6b3 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a431c9708f4694bc0d514133e76088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a1921237622439bab89676e11477c13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:30:56.773575 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-96319e39-5d40-40e2-93c3-dbbe4bb6b6b3 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] 10.222.0.33 "GET /compute/v2.1/servers/591fab72-3729-4b6f-af75-cc55766b7eae" status: 200 len: 1510 microversion: 2.1 time: 0.235093 Jul 18 10:30:56.774412 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 138/279] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:30:56 2022] GET /compute/v2.1/servers/591fab72-3729-4b6f-af75-cc55766b7eae => generated 1510 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:30:57.792704 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-2cdf8a8f-3fde-46c9-8273-ea05397f9e28 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:30:57.794414 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-2cdf8a8f-3fde-46c9-8273-ea05397f9e28 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] [instance: 591fab72-3729-4b6f-af75-cc55766b7eae] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:30:57.794652 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-ff4c3ba9-a4f7-4406-b500-9b8954cdcfa1 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2063243999", "imageRef": "2cb02169-9999-411b-8c74-f88c068960fc", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a8d66173-a1e2-46af-a5dc-6e62a2d0a4e4"}], "security_groups": [{"name": "tempest-securitygroup--220334981"}], "key_name": "tempest-keypair-1607051564", "user_data": "}} {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:30:57.805867 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-2cdf8a8f-3fde-46c9-8273-ea05397f9e28 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:30:57.806797 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-2cdf8a8f-3fde-46c9-8273-ea05397f9e28 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:30:57.807811 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-2cdf8a8f-3fde-46c9-8273-ea05397f9e28 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:30:57.808447 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-2cdf8a8f-3fde-46c9-8273-ea05397f9e28 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:30:58.073367 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.network.neutron [None req-ff4c3ba9-a4f7-4406-b500-9b8954cdcfa1 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] validate_networks() for [('a8d66173-a1e2-46af-a5dc-6e62a2d0a4e4', None, None, None, None, None)] {{(pid=117879) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 10:30:58.157070 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-2cdf8a8f-3fde-46c9-8273-ea05397f9e28 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a431c9708f4694bc0d514133e76088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a1921237622439bab89676e11477c13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:30:58.167483 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-2cdf8a8f-3fde-46c9-8273-ea05397f9e28 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] 10.222.0.33 "GET /compute/v2.1/servers/591fab72-3729-4b6f-af75-cc55766b7eae" status: 200 len: 1510 microversion: 2.1 time: 0.378554 Jul 18 10:30:58.168592 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 139/280] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:30:57 2022] GET /compute/v2.1/servers/591fab72-3729-4b6f-af75-cc55766b7eae => generated 1510 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:30:58.648497 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.virt.hardware [None req-ff4c3ba9-a4f7-4406-b500-9b8954cdcfa1 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Flavor limits 0:0:0 {{(pid=117879) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 10:30:58.649386 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.virt.hardware [None req-ff4c3ba9-a4f7-4406-b500-9b8954cdcfa1 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Image limits 0:0:0 {{(pid=117879) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 10:30:58.649860 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.virt.hardware [None req-ff4c3ba9-a4f7-4406-b500-9b8954cdcfa1 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Flavor pref 0:0:0 {{(pid=117879) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 10:30:58.650265 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.virt.hardware [None req-ff4c3ba9-a4f7-4406-b500-9b8954cdcfa1 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Image pref 0:0:0 {{(pid=117879) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 10:30:58.650669 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.virt.hardware [None req-ff4c3ba9-a4f7-4406-b500-9b8954cdcfa1 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117879) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 10:30:58.662719 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-ff4c3ba9-a4f7-4406-b500-9b8954cdcfa1 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:30:58.663344 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-ff4c3ba9-a4f7-4406-b500-9b8954cdcfa1 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:30:58.664329 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-ff4c3ba9-a4f7-4406-b500-9b8954cdcfa1 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:30:58.665066 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-ff4c3ba9-a4f7-4406-b500-9b8954cdcfa1 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:30:58.684896 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.quota [None req-ff4c3ba9-a4f7-4406-b500-9b8954cdcfa1 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Getting quotas for project 1cf3d5bfe9a745f38372c42c9cfa1f63. Resources: {'ram', 'cores', 'instances'} {{(pid=117879) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 10:30:58.689308 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.quota [None req-ff4c3ba9-a4f7-4406-b500-9b8954cdcfa1 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Getting quotas for user f25c72896a2d4d619e5ad4b5a0a79aa6 and project 1cf3d5bfe9a745f38372c42c9cfa1f63. Resources: {'ram', 'cores', 'instances'} {{(pid=117879) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 10:30:58.701901 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-ff4c3ba9-a4f7-4406-b500-9b8954cdcfa1 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Going to run 1 instances... {{(pid=117879) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 10:30:58.705595 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-ff4c3ba9-a4f7-4406-b500-9b8954cdcfa1 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] [instance: 1e3ca3fe-e03a-47e3-9d9c-a6ab431e2dd7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2cb02169-9999-411b-8c74-f88c068960fc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117879) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 10:30:58.787015 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-ff4c3ba9-a4f7-4406-b500-9b8954cdcfa1 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.997952 Jul 18 10:30:58.788550 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 142/281] 10.222.0.33 () {60 vars in 1146 bytes} [Mon Jul 18 10:30:57 2022] POST /compute/v2.1/servers => generated 401 bytes in 1000 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 10:30:58.799111 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-a71ea5c1-c1b5-47c5-923a-745d5927aa7f tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:30:58.801059 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-a71ea5c1-c1b5-47c5-923a-745d5927aa7f tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] [instance: 1e3ca3fe-e03a-47e3-9d9c-a6ab431e2dd7] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:30:58.893736 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-a71ea5c1-c1b5-47c5-923a-745d5927aa7f tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f25c72896a2d4d619e5ad4b5a0a79aa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cf3d5bfe9a745f38372c42c9cfa1f63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:30:58.916637 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-a71ea5c1-c1b5-47c5-923a-745d5927aa7f tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] 10.222.0.33 "GET /compute/v2.1/servers/1e3ca3fe-e03a-47e3-9d9c-a6ab431e2dd7" status: 200 len: 1242 microversion: 2.1 time: 0.122081 Jul 18 10:30:58.919064 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 140/282] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:30:58 2022] GET /compute/v2.1/servers/1e3ca3fe-e03a-47e3-9d9c-a6ab431e2dd7 => generated 1242 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:30:59.186442 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-ce8c032e-16fc-48dc-8d14-0f6d80103ef0 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:30:59.187280 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-ce8c032e-16fc-48dc-8d14-0f6d80103ef0 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] [instance: 591fab72-3729-4b6f-af75-cc55766b7eae] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:30:59.206547 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-ce8c032e-16fc-48dc-8d14-0f6d80103ef0 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:30:59.207320 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-ce8c032e-16fc-48dc-8d14-0f6d80103ef0 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:30:59.209504 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-ce8c032e-16fc-48dc-8d14-0f6d80103ef0 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:30:59.210332 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-ce8c032e-16fc-48dc-8d14-0f6d80103ef0 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:30:59.483403 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-ce8c032e-16fc-48dc-8d14-0f6d80103ef0 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a431c9708f4694bc0d514133e76088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a1921237622439bab89676e11477c13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:30:59.503212 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-ce8c032e-16fc-48dc-8d14-0f6d80103ef0 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] 10.222.0.33 "GET /compute/v2.1/servers/591fab72-3729-4b6f-af75-cc55766b7eae" status: 200 len: 1516 microversion: 2.1 time: 0.318279 Jul 18 10:30:59.517605 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 143/283] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:30:59 2022] GET /compute/v2.1/servers/591fab72-3729-4b6f-af75-cc55766b7eae => generated 1516 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:30:59.947310 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-b180da51-b5b5-414b-ba8d-dfbf5c1d7b58 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:30:59.948696 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-b180da51-b5b5-414b-ba8d-dfbf5c1d7b58 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] [instance: 1e3ca3fe-e03a-47e3-9d9c-a6ab431e2dd7] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:30:59.956617 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-b180da51-b5b5-414b-ba8d-dfbf5c1d7b58 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:30:59.957108 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-b180da51-b5b5-414b-ba8d-dfbf5c1d7b58 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:30:59.958291 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-b180da51-b5b5-414b-ba8d-dfbf5c1d7b58 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:30:59.958891 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-b180da51-b5b5-414b-ba8d-dfbf5c1d7b58 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:31:00.041964 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-b180da51-b5b5-414b-ba8d-dfbf5c1d7b58 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f25c72896a2d4d619e5ad4b5a0a79aa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cf3d5bfe9a745f38372c42c9cfa1f63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:31:00.055649 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-b180da51-b5b5-414b-ba8d-dfbf5c1d7b58 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] 10.222.0.33 "GET /compute/v2.1/servers/1e3ca3fe-e03a-47e3-9d9c-a6ab431e2dd7" status: 200 len: 1294 microversion: 2.1 time: 0.125314 Jul 18 10:31:00.057016 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 141/284] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:30:59 2022] GET /compute/v2.1/servers/1e3ca3fe-e03a-47e3-9d9c-a6ab431e2dd7 => generated 1294 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:31:01.075775 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-16a84727-1b81-47e6-97e3-02a69be5fe8b tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:31:01.076579 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-16a84727-1b81-47e6-97e3-02a69be5fe8b tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] [instance: 1e3ca3fe-e03a-47e3-9d9c-a6ab431e2dd7] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:31:01.101713 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-16a84727-1b81-47e6-97e3-02a69be5fe8b tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:31:01.115267 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-16a84727-1b81-47e6-97e3-02a69be5fe8b tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:31:01.118403 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-16a84727-1b81-47e6-97e3-02a69be5fe8b tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:31:01.119241 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-16a84727-1b81-47e6-97e3-02a69be5fe8b tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:31:01.216119 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-d129f146-e3ab-43d0-806f-e4a3e0f73f88 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Action: 'create', calling method: .version_select at 0x7f9f4a2194c0>, body: {"keypair": {"name": "tempest-keypair-843877681", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIk4yF9Yo02opYMJ+E0+LnHZKjhpO72InHf0TTAh0O/+if50XmQTLVGFfNoRndrJjVVL8BK3F3MGBXYFqOy/n3yx/32aVccastR/wvdS9fIHJvXk9iH5oVaCeOkWitvC0Q=="}} {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:31:01.248794 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.quota [None req-d129f146-e3ab-43d0-806f-e4a3e0f73f88 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Getting quotas for project 8a1921237622439bab89676e11477c13. Resources: {'key_pairs'} {{(pid=117880) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 10:31:01.264224 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.quota [None req-d129f146-e3ab-43d0-806f-e4a3e0f73f88 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Getting quotas for user 72a431c9708f4694bc0d514133e76088 and project 8a1921237622439bab89676e11477c13. Resources: {'key_pairs'} {{(pid=117880) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 10:31:01.325565 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-d129f146-e3ab-43d0-806f-e4a3e0f73f88 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.115665 Jul 18 10:31:01.326768 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 142/285] 10.222.0.33 () {60 vars in 1158 bytes} [Mon Jul 18 10:31:01 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:31:01.657786 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-16a84727-1b81-47e6-97e3-02a69be5fe8b tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f25c72896a2d4d619e5ad4b5a0a79aa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cf3d5bfe9a745f38372c42c9cfa1f63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:31:01.667166 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-16a84727-1b81-47e6-97e3-02a69be5fe8b tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] 10.222.0.33 "GET /compute/v2.1/servers/1e3ca3fe-e03a-47e3-9d9c-a6ab431e2dd7" status: 200 len: 1312 microversion: 2.1 time: 0.595945 Jul 18 10:31:01.672987 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 144/286] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:31:01 2022] GET /compute/v2.1/servers/1e3ca3fe-e03a-47e3-9d9c-a6ab431e2dd7 => generated 1312 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:31:01.775355 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-dbbd2cd9-3a99-493f-9fbc-0b0981592b90 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:31:01.797044 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-dbbd2cd9-3a99-493f-9fbc-0b0981592b90 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:31:01.799963 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-dbbd2cd9-3a99-493f-9fbc-0b0981592b90 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:31:01.908723 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-dbbd2cd9-3a99-493f-9fbc-0b0981592b90 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] [instance: dcb1b50b-9e62-4ff3-9875-3d4635597b45] Going to try to stop instance {{(pid=117880) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 18 10:31:01.991828 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-dbbd2cd9-3a99-493f-9fbc-0b0981592b90 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] 10.222.0.33 "POST /compute/v2.1/servers/dcb1b50b-9e62-4ff3-9875-3d4635597b45/action" status: 202 len: 0 microversion: 2.1 time: 0.224010 Jul 18 10:31:01.993189 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 143/287] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Jul 18 10:31:01 2022] POST /compute/v2.1/servers/dcb1b50b-9e62-4ff3-9875-3d4635597b45/action => generated 0 bytes in 227 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 10:31:02.002871 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-270f5200-a397-4be5-8466-5e5a37018829 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:31:02.003638 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-270f5200-a397-4be5-8466-5e5a37018829 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] [instance: dcb1b50b-9e62-4ff3-9875-3d4635597b45] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:31:02.012122 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-270f5200-a397-4be5-8466-5e5a37018829 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:31:02.012917 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-270f5200-a397-4be5-8466-5e5a37018829 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:31:02.013864 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-270f5200-a397-4be5-8466-5e5a37018829 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:31:02.014464 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-270f5200-a397-4be5-8466-5e5a37018829 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:31:02.311257 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-270f5200-a397-4be5-8466-5e5a37018829 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '986f90dfbad14324b3fffbd790d60a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e487deb7ff45bdbf2cc002d42d12a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:31:02.321941 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-270f5200-a397-4be5-8466-5e5a37018829 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] 10.222.0.33 "GET /compute/v2.1/servers/dcb1b50b-9e62-4ff3-9875-3d4635597b45" status: 200 len: 1721 microversion: 2.1 time: 0.324814 Jul 18 10:31:02.322895 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 145/288] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:31:01 2022] GET /compute/v2.1/servers/dcb1b50b-9e62-4ff3-9875-3d4635597b45 => generated 1721 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:31:02.687367 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-8c829a14-9682-4b60-bea5-d7bc16a460b8 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:31:02.689237 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-8c829a14-9682-4b60-bea5-d7bc16a460b8 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] [instance: 1e3ca3fe-e03a-47e3-9d9c-a6ab431e2dd7] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:31:02.707293 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-8c829a14-9682-4b60-bea5-d7bc16a460b8 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:31:02.708017 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-8c829a14-9682-4b60-bea5-d7bc16a460b8 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:31:02.708910 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-8c829a14-9682-4b60-bea5-d7bc16a460b8 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:31:02.709561 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-8c829a14-9682-4b60-bea5-d7bc16a460b8 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:31:02.929784 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-8c829a14-9682-4b60-bea5-d7bc16a460b8 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f25c72896a2d4d619e5ad4b5a0a79aa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cf3d5bfe9a745f38372c42c9cfa1f63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:31:02.939515 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-8c829a14-9682-4b60-bea5-d7bc16a460b8 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] 10.222.0.33 "GET /compute/v2.1/servers/1e3ca3fe-e03a-47e3-9d9c-a6ab431e2dd7" status: 200 len: 1367 microversion: 2.1 time: 0.256254 Jul 18 10:31:02.940639 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 144/289] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:31:02 2022] GET /compute/v2.1/servers/1e3ca3fe-e03a-47e3-9d9c-a6ab431e2dd7 => generated 1367 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:31:03.162157 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-5d851f0c-c901-4350-b72d-7aad972faad2 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1788118114", "imageRef": "2cb02169-9999-411b-8c74-f88c068960fc", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3122165b-a136-4d21-b84f-81ce161e0ad4"}], "security_groups": [{"name": "tempest-securitygroup--1889102592"}], "key_name": "tempest-keypair-843877681", "user_data": "}} {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:31:03.311889 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.network.neutron [None req-5d851f0c-c901-4350-b72d-7aad972faad2 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] validate_networks() for [('3122165b-a136-4d21-b84f-81ce161e0ad4', None, None, None, None, None)] {{(pid=117879) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 10:31:03.339780 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-4124f9b1-cb40-44c3-80c9-27f5eb2b4bb7 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:31:03.340416 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-4124f9b1-cb40-44c3-80c9-27f5eb2b4bb7 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] [instance: dcb1b50b-9e62-4ff3-9875-3d4635597b45] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:31:03.346010 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG dbcounter [-] [117880] Writing DB stats nova_api:SELECT=72,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=117880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:31:03.351220 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-4124f9b1-cb40-44c3-80c9-27f5eb2b4bb7 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:31:03.351913 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-4124f9b1-cb40-44c3-80c9-27f5eb2b4bb7 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:31:03.352911 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-4124f9b1-cb40-44c3-80c9-27f5eb2b4bb7 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:31:03.353851 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-4124f9b1-cb40-44c3-80c9-27f5eb2b4bb7 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:31:03.611019 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-4124f9b1-cb40-44c3-80c9-27f5eb2b4bb7 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '986f90dfbad14324b3fffbd790d60a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e487deb7ff45bdbf2cc002d42d12a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:31:03.621156 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-4124f9b1-cb40-44c3-80c9-27f5eb2b4bb7 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] 10.222.0.33 "GET /compute/v2.1/servers/dcb1b50b-9e62-4ff3-9875-3d4635597b45" status: 200 len: 1721 microversion: 2.1 time: 0.285453 Jul 18 10:31:03.630959 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 145/290] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:31:03 2022] GET /compute/v2.1/servers/dcb1b50b-9e62-4ff3-9875-3d4635597b45 => generated 1721 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:31:03.820282 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.virt.hardware [None req-5d851f0c-c901-4350-b72d-7aad972faad2 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Flavor limits 0:0:0 {{(pid=117879) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 10:31:03.820735 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.virt.hardware [None req-5d851f0c-c901-4350-b72d-7aad972faad2 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Image limits 0:0:0 {{(pid=117879) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 10:31:03.821210 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.virt.hardware [None req-5d851f0c-c901-4350-b72d-7aad972faad2 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Flavor pref 0:0:0 {{(pid=117879) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 10:31:03.821615 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.virt.hardware [None req-5d851f0c-c901-4350-b72d-7aad972faad2 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Image pref 0:0:0 {{(pid=117879) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 10:31:03.822022 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.virt.hardware [None req-5d851f0c-c901-4350-b72d-7aad972faad2 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117879) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 10:31:03.831583 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-5d851f0c-c901-4350-b72d-7aad972faad2 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:31:03.832036 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-5d851f0c-c901-4350-b72d-7aad972faad2 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:31:03.832927 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-5d851f0c-c901-4350-b72d-7aad972faad2 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:31:03.833369 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-5d851f0c-c901-4350-b72d-7aad972faad2 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:31:03.852773 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.quota [None req-5d851f0c-c901-4350-b72d-7aad972faad2 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Getting quotas for project 8a1921237622439bab89676e11477c13. Resources: {'ram', 'cores', 'instances'} {{(pid=117879) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 10:31:03.857841 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.quota [None req-5d851f0c-c901-4350-b72d-7aad972faad2 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Getting quotas for user 72a431c9708f4694bc0d514133e76088 and project 8a1921237622439bab89676e11477c13. Resources: {'ram', 'cores', 'instances'} {{(pid=117879) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 10:31:03.871185 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-5d851f0c-c901-4350-b72d-7aad972faad2 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Going to run 1 instances... {{(pid=117879) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 10:31:03.873721 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-5d851f0c-c901-4350-b72d-7aad972faad2 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] [instance: a3dbac58-662d-4720-8bcf-2300f9a9a5d1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2cb02169-9999-411b-8c74-f88c068960fc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117879) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 10:31:03.937594 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-5d851f0c-c901-4350-b72d-7aad972faad2 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.780021 Jul 18 10:31:03.943066 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 146/291] 10.222.0.33 () {60 vars in 1146 bytes} [Mon Jul 18 10:31:03 2022] POST /compute/v2.1/servers => generated 409 bytes in 782 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 10:31:03.960714 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-cb8e6d2d-95fc-4fc7-98b2-3cac488dd6b8 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:31:03.961750 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-cb8e6d2d-95fc-4fc7-98b2-3cac488dd6b8 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] [instance: a3dbac58-662d-4720-8bcf-2300f9a9a5d1] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:31:03.966007 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-0a9784e6-ce42-40e9-82d3-59e3098eba11 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:31:03.966624 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-0a9784e6-ce42-40e9-82d3-59e3098eba11 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] [instance: 1e3ca3fe-e03a-47e3-9d9c-a6ab431e2dd7] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:31:03.982059 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-0a9784e6-ce42-40e9-82d3-59e3098eba11 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:31:03.982823 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-0a9784e6-ce42-40e9-82d3-59e3098eba11 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:31:03.984145 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-0a9784e6-ce42-40e9-82d3-59e3098eba11 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:31:03.990834 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-0a9784e6-ce42-40e9-82d3-59e3098eba11 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:31:04.053894 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-cb8e6d2d-95fc-4fc7-98b2-3cac488dd6b8 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a431c9708f4694bc0d514133e76088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a1921237622439bab89676e11477c13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:31:04.078316 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-cb8e6d2d-95fc-4fc7-98b2-3cac488dd6b8 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] 10.222.0.33 "GET /compute/v2.1/servers/a3dbac58-662d-4720-8bcf-2300f9a9a5d1" status: 200 len: 1245 microversion: 2.1 time: 0.130001 Jul 18 10:31:04.086075 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 146/292] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:31:03 2022] GET /compute/v2.1/servers/a3dbac58-662d-4720-8bcf-2300f9a9a5d1 => generated 1245 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:31:04.258136 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-0a9784e6-ce42-40e9-82d3-59e3098eba11 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f25c72896a2d4d619e5ad4b5a0a79aa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cf3d5bfe9a745f38372c42c9cfa1f63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:31:04.267381 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-0a9784e6-ce42-40e9-82d3-59e3098eba11 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] 10.222.0.33 "GET /compute/v2.1/servers/1e3ca3fe-e03a-47e3-9d9c-a6ab431e2dd7" status: 200 len: 1367 microversion: 2.1 time: 0.312727 Jul 18 10:31:04.269923 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 147/293] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:31:03 2022] GET /compute/v2.1/servers/1e3ca3fe-e03a-47e3-9d9c-a6ab431e2dd7 => generated 1367 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:31:04.645783 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-245d9fcc-8c65-4fe3-b601-45e77cf5bdff tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:31:04.649126 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-245d9fcc-8c65-4fe3-b601-45e77cf5bdff tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] [instance: dcb1b50b-9e62-4ff3-9875-3d4635597b45] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:31:04.658650 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-245d9fcc-8c65-4fe3-b601-45e77cf5bdff tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:31:04.659540 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-245d9fcc-8c65-4fe3-b601-45e77cf5bdff tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:31:04.660563 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-245d9fcc-8c65-4fe3-b601-45e77cf5bdff tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:31:04.662175 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-245d9fcc-8c65-4fe3-b601-45e77cf5bdff tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:31:05.034154 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-245d9fcc-8c65-4fe3-b601-45e77cf5bdff tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '986f90dfbad14324b3fffbd790d60a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e487deb7ff45bdbf2cc002d42d12a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:31:05.046191 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-245d9fcc-8c65-4fe3-b601-45e77cf5bdff tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] 10.222.0.33 "GET /compute/v2.1/servers/dcb1b50b-9e62-4ff3-9875-3d4635597b45" status: 200 len: 1721 microversion: 2.1 time: 0.410061 Jul 18 10:31:05.047115 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 147/294] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:31:04 2022] GET /compute/v2.1/servers/dcb1b50b-9e62-4ff3-9875-3d4635597b45 => generated 1721 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:31:05.105064 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-809d79b5-0acf-4c1f-994e-b97a91a7db4b tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:31:05.105740 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-809d79b5-0acf-4c1f-994e-b97a91a7db4b tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] [instance: a3dbac58-662d-4720-8bcf-2300f9a9a5d1] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:31:05.120569 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-809d79b5-0acf-4c1f-994e-b97a91a7db4b tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:31:05.124747 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-809d79b5-0acf-4c1f-994e-b97a91a7db4b tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:31:05.126520 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-809d79b5-0acf-4c1f-994e-b97a91a7db4b tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:31:05.127048 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-809d79b5-0acf-4c1f-994e-b97a91a7db4b tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:31:05.263286 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-809d79b5-0acf-4c1f-994e-b97a91a7db4b tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a431c9708f4694bc0d514133e76088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a1921237622439bab89676e11477c13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:31:05.287733 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-131fffc6-b55b-4734-a23c-c788d3f7edee tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:31:05.288726 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-131fffc6-b55b-4734-a23c-c788d3f7edee tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] [instance: 1e3ca3fe-e03a-47e3-9d9c-a6ab431e2dd7] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:31:05.295706 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-131fffc6-b55b-4734-a23c-c788d3f7edee tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:31:05.296144 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-131fffc6-b55b-4734-a23c-c788d3f7edee tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:31:05.296943 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-131fffc6-b55b-4734-a23c-c788d3f7edee tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:31:05.297944 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-809d79b5-0acf-4c1f-994e-b97a91a7db4b tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] 10.222.0.33 "GET /compute/v2.1/servers/a3dbac58-662d-4720-8bcf-2300f9a9a5d1" status: 200 len: 1297 microversion: 2.1 time: 0.198637 Jul 18 10:31:05.298193 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-131fffc6-b55b-4734-a23c-c788d3f7edee tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:31:05.308839 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 148/295] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:31:05 2022] GET /compute/v2.1/servers/a3dbac58-662d-4720-8bcf-2300f9a9a5d1 => generated 1297 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:31:05.345314 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [req-493b0a25-bb94-49f1-a09a-8f4bb9e27392 req-87a0a6c4-17de-4b58-9995-a9611ee2cd91 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1e3ca3fe-e03a-47e3-9d9c-a6ab431e2dd7", "tag": "45d07fc3-9cad-4182-885d-f3a4c1ec9917"}]} {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:31:05.359540 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [req-493b0a25-bb94-49f1-a09a-8f4bb9e27392 req-87a0a6c4-17de-4b58-9995-a9611ee2cd91 service nova] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:31:05.361613 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [req-493b0a25-bb94-49f1-a09a-8f4bb9e27392 req-87a0a6c4-17de-4b58-9995-a9611ee2cd91 service nova] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:31:05.381634 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.compute.server_external_events [req-493b0a25-bb94-49f1-a09a-8f4bb9e27392 req-87a0a6c4-17de-4b58-9995-a9611ee2cd91 service nova] Creating event network-changed:45d07fc3-9cad-4182-885d-f3a4c1ec9917 for instance 1e3ca3fe-e03a-47e3-9d9c-a6ab431e2dd7 on hv-cinder-83754 Jul 18 10:31:05.388121 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [req-493b0a25-bb94-49f1-a09a-8f4bb9e27392 req-87a0a6c4-17de-4b58-9995-a9611ee2cd91 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046203 Jul 18 10:31:05.389397 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 149/296] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jul 18 10:31:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:31:05.841026 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-131fffc6-b55b-4734-a23c-c788d3f7edee tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f25c72896a2d4d619e5ad4b5a0a79aa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cf3d5bfe9a745f38372c42c9cfa1f63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:31:05.848624 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-131fffc6-b55b-4734-a23c-c788d3f7edee tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] 10.222.0.33 "GET /compute/v2.1/servers/1e3ca3fe-e03a-47e3-9d9c-a6ab431e2dd7" status: 200 len: 1367 microversion: 2.1 time: 0.565021 Jul 18 10:31:05.858606 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 148/297] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:31:05 2022] GET /compute/v2.1/servers/1e3ca3fe-e03a-47e3-9d9c-a6ab431e2dd7 => generated 1367 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:31:06.065151 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-681d7d86-7370-4a0b-92f8-ca2a7e2d3d02 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:31:06.065769 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-681d7d86-7370-4a0b-92f8-ca2a7e2d3d02 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] [instance: dcb1b50b-9e62-4ff3-9875-3d4635597b45] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:31:06.072366 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-681d7d86-7370-4a0b-92f8-ca2a7e2d3d02 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:31:06.072852 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-681d7d86-7370-4a0b-92f8-ca2a7e2d3d02 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:31:06.073638 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-681d7d86-7370-4a0b-92f8-ca2a7e2d3d02 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:31:06.074083 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-681d7d86-7370-4a0b-92f8-ca2a7e2d3d02 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:31:06.232190 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-681d7d86-7370-4a0b-92f8-ca2a7e2d3d02 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '986f90dfbad14324b3fffbd790d60a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e487deb7ff45bdbf2cc002d42d12a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:31:06.240983 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-681d7d86-7370-4a0b-92f8-ca2a7e2d3d02 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] 10.222.0.33 "GET /compute/v2.1/servers/dcb1b50b-9e62-4ff3-9875-3d4635597b45" status: 200 len: 1721 microversion: 2.1 time: 0.180905 Jul 18 10:31:06.241531 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 150/298] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:31:06 2022] GET /compute/v2.1/servers/dcb1b50b-9e62-4ff3-9875-3d4635597b45 => generated 1721 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:31:06.315498 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-601da6b0-c4b1-4dd7-93cd-479994b01ace tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:31:06.316034 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-601da6b0-c4b1-4dd7-93cd-479994b01ace tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] [instance: a3dbac58-662d-4720-8bcf-2300f9a9a5d1] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:31:06.322521 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-601da6b0-c4b1-4dd7-93cd-479994b01ace tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:31:06.322974 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-601da6b0-c4b1-4dd7-93cd-479994b01ace tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:31:06.323739 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-601da6b0-c4b1-4dd7-93cd-479994b01ace tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:31:06.324578 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-601da6b0-c4b1-4dd7-93cd-479994b01ace tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:31:06.385006 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-601da6b0-c4b1-4dd7-93cd-479994b01ace tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a431c9708f4694bc0d514133e76088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a1921237622439bab89676e11477c13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:31:06.392371 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-601da6b0-c4b1-4dd7-93cd-479994b01ace tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] 10.222.0.33 "GET /compute/v2.1/servers/a3dbac58-662d-4720-8bcf-2300f9a9a5d1" status: 200 len: 1303 microversion: 2.1 time: 0.080800 Jul 18 10:31:06.392963 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 149/299] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:31:06 2022] GET /compute/v2.1/servers/a3dbac58-662d-4720-8bcf-2300f9a9a5d1 => generated 1303 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:31:06.866509 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-8bc25eec-8b7b-49f4-b409-01be53514191 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:31:06.867140 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-8bc25eec-8b7b-49f4-b409-01be53514191 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] [instance: 1e3ca3fe-e03a-47e3-9d9c-a6ab431e2dd7] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:31:06.873521 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-8bc25eec-8b7b-49f4-b409-01be53514191 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:31:06.873969 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-8bc25eec-8b7b-49f4-b409-01be53514191 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:31:06.874721 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-8bc25eec-8b7b-49f4-b409-01be53514191 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:31:06.875150 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-8bc25eec-8b7b-49f4-b409-01be53514191 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:31:07.002482 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-8bc25eec-8b7b-49f4-b409-01be53514191 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f25c72896a2d4d619e5ad4b5a0a79aa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cf3d5bfe9a745f38372c42c9cfa1f63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:31:07.009871 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-8bc25eec-8b7b-49f4-b409-01be53514191 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] 10.222.0.33 "GET /compute/v2.1/servers/1e3ca3fe-e03a-47e3-9d9c-a6ab431e2dd7" status: 200 len: 1367 microversion: 2.1 time: 0.147350 Jul 18 10:31:07.010427 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 151/300] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:31:06 2022] GET /compute/v2.1/servers/1e3ca3fe-e03a-47e3-9d9c-a6ab431e2dd7 => generated 1367 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:31:07.257757 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-5fb77627-3cc5-42e4-ac9d-8624ed81460a tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:31:07.258380 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-5fb77627-3cc5-42e4-ac9d-8624ed81460a tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] [instance: dcb1b50b-9e62-4ff3-9875-3d4635597b45] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:31:07.264314 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-5fb77627-3cc5-42e4-ac9d-8624ed81460a tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:31:07.264798 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-5fb77627-3cc5-42e4-ac9d-8624ed81460a tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:31:07.265559 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-5fb77627-3cc5-42e4-ac9d-8624ed81460a tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:31:07.266036 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-5fb77627-3cc5-42e4-ac9d-8624ed81460a tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:31:07.393518 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-5fb77627-3cc5-42e4-ac9d-8624ed81460a tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '986f90dfbad14324b3fffbd790d60a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e487deb7ff45bdbf2cc002d42d12a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:31:07.401259 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-5fb77627-3cc5-42e4-ac9d-8624ed81460a tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] 10.222.0.33 "GET /compute/v2.1/servers/dcb1b50b-9e62-4ff3-9875-3d4635597b45" status: 200 len: 1721 microversion: 2.1 time: 0.147288 Jul 18 10:31:07.401813 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 150/301] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:31:07 2022] GET /compute/v2.1/servers/dcb1b50b-9e62-4ff3-9875-3d4635597b45 => generated 1721 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:31:07.408989 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-b1a0bf39-8133-47de-bd7d-914573738f79 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:31:07.409632 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-b1a0bf39-8133-47de-bd7d-914573738f79 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] [instance: a3dbac58-662d-4720-8bcf-2300f9a9a5d1] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:31:07.416003 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-b1a0bf39-8133-47de-bd7d-914573738f79 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:31:07.416452 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-b1a0bf39-8133-47de-bd7d-914573738f79 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:31:07.417247 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-b1a0bf39-8133-47de-bd7d-914573738f79 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:31:07.417680 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-b1a0bf39-8133-47de-bd7d-914573738f79 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:31:07.421621 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG dbcounter [-] [117879] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:31:07.482595 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-b1a0bf39-8133-47de-bd7d-914573738f79 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a431c9708f4694bc0d514133e76088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a1921237622439bab89676e11477c13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:31:07.490389 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-b1a0bf39-8133-47de-bd7d-914573738f79 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] 10.222.0.33 "GET /compute/v2.1/servers/a3dbac58-662d-4720-8bcf-2300f9a9a5d1" status: 200 len: 1303 microversion: 2.1 time: 0.085203 Jul 18 10:31:07.490945 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 152/302] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:31:07 2022] GET /compute/v2.1/servers/a3dbac58-662d-4720-8bcf-2300f9a9a5d1 => generated 1303 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:31:08.027149 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-2c59ce95-9df1-4af7-80ff-f7fe3821b4a5 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:31:08.027678 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-2c59ce95-9df1-4af7-80ff-f7fe3821b4a5 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] [instance: 1e3ca3fe-e03a-47e3-9d9c-a6ab431e2dd7] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:31:08.033666 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-2c59ce95-9df1-4af7-80ff-f7fe3821b4a5 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:31:08.034110 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-2c59ce95-9df1-4af7-80ff-f7fe3821b4a5 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:31:08.034863 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-2c59ce95-9df1-4af7-80ff-f7fe3821b4a5 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:31:08.035295 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-2c59ce95-9df1-4af7-80ff-f7fe3821b4a5 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:31:08.164811 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-2c59ce95-9df1-4af7-80ff-f7fe3821b4a5 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f25c72896a2d4d619e5ad4b5a0a79aa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cf3d5bfe9a745f38372c42c9cfa1f63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:31:08.173063 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-2c59ce95-9df1-4af7-80ff-f7fe3821b4a5 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] 10.222.0.33 "GET /compute/v2.1/servers/1e3ca3fe-e03a-47e3-9d9c-a6ab431e2dd7" status: 200 len: 1367 microversion: 2.1 time: 0.149229 Jul 18 10:31:08.173663 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 151/303] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:31:08 2022] GET /compute/v2.1/servers/1e3ca3fe-e03a-47e3-9d9c-a6ab431e2dd7 => generated 1367 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:31:08.418544 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-7bf8fc29-39a6-4bce-b1bc-21cccd139347 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:31:08.419189 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-7bf8fc29-39a6-4bce-b1bc-21cccd139347 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] [instance: dcb1b50b-9e62-4ff3-9875-3d4635597b45] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:31:08.426133 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-7bf8fc29-39a6-4bce-b1bc-21cccd139347 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:31:08.426587 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-7bf8fc29-39a6-4bce-b1bc-21cccd139347 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:31:08.427349 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-7bf8fc29-39a6-4bce-b1bc-21cccd139347 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:31:08.427789 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-7bf8fc29-39a6-4bce-b1bc-21cccd139347 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:31:08.507233 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-22d0ab7d-3e10-499a-8d2b-604e2edc9e00 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:31:08.507830 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-22d0ab7d-3e10-499a-8d2b-604e2edc9e00 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] [instance: a3dbac58-662d-4720-8bcf-2300f9a9a5d1] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:31:08.514260 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-22d0ab7d-3e10-499a-8d2b-604e2edc9e00 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:31:08.514694 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-22d0ab7d-3e10-499a-8d2b-604e2edc9e00 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:31:08.515462 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-22d0ab7d-3e10-499a-8d2b-604e2edc9e00 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:31:08.515889 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-22d0ab7d-3e10-499a-8d2b-604e2edc9e00 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:31:08.611826 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-22d0ab7d-3e10-499a-8d2b-604e2edc9e00 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a431c9708f4694bc0d514133e76088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a1921237622439bab89676e11477c13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:31:08.620346 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-22d0ab7d-3e10-499a-8d2b-604e2edc9e00 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] 10.222.0.33 "GET /compute/v2.1/servers/a3dbac58-662d-4720-8bcf-2300f9a9a5d1" status: 200 len: 1303 microversion: 2.1 time: 0.115996 Jul 18 10:31:08.621145 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 152/304] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:31:08 2022] GET /compute/v2.1/servers/a3dbac58-662d-4720-8bcf-2300f9a9a5d1 => generated 1303 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:31:08.752898 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-7bf8fc29-39a6-4bce-b1bc-21cccd139347 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '986f90dfbad14324b3fffbd790d60a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e487deb7ff45bdbf2cc002d42d12a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:31:08.761457 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-7bf8fc29-39a6-4bce-b1bc-21cccd139347 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] 10.222.0.33 "GET /compute/v2.1/servers/dcb1b50b-9e62-4ff3-9875-3d4635597b45" status: 200 len: 1721 microversion: 2.1 time: 0.346664 Jul 18 10:31:08.762112 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 153/305] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:31:08 2022] GET /compute/v2.1/servers/dcb1b50b-9e62-4ff3-9875-3d4635597b45 => generated 1721 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:31:09.191987 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-b01b7a69-0dba-408e-a136-995d4c08034c tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:31:09.192683 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-b01b7a69-0dba-408e-a136-995d4c08034c tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] [instance: 1e3ca3fe-e03a-47e3-9d9c-a6ab431e2dd7] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:31:09.199656 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-b01b7a69-0dba-408e-a136-995d4c08034c tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:31:09.200102 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-b01b7a69-0dba-408e-a136-995d4c08034c tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:31:09.200891 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-b01b7a69-0dba-408e-a136-995d4c08034c tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:31:09.201320 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-b01b7a69-0dba-408e-a136-995d4c08034c tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:31:09.637538 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-542a5ef2-8329-4cd5-a28a-6180bc93abad tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:31:09.638147 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-542a5ef2-8329-4cd5-a28a-6180bc93abad tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] [instance: a3dbac58-662d-4720-8bcf-2300f9a9a5d1] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:31:09.645866 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-542a5ef2-8329-4cd5-a28a-6180bc93abad tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:31:09.646327 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-542a5ef2-8329-4cd5-a28a-6180bc93abad tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:31:09.648221 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-542a5ef2-8329-4cd5-a28a-6180bc93abad tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:31:09.648694 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-542a5ef2-8329-4cd5-a28a-6180bc93abad tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:31:09.662309 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-b01b7a69-0dba-408e-a136-995d4c08034c tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f25c72896a2d4d619e5ad4b5a0a79aa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cf3d5bfe9a745f38372c42c9cfa1f63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:31:09.677602 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-b01b7a69-0dba-408e-a136-995d4c08034c tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] 10.222.0.33 "GET /compute/v2.1/servers/1e3ca3fe-e03a-47e3-9d9c-a6ab431e2dd7" status: 200 len: 1367 microversion: 2.1 time: 0.491262 Jul 18 10:31:09.678391 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 153/306] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:31:09 2022] GET /compute/v2.1/servers/1e3ca3fe-e03a-47e3-9d9c-a6ab431e2dd7 => generated 1367 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:31:09.783927 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-a77433c8-c714-4d24-ac10-0b50535b017d tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:31:09.785369 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-a77433c8-c714-4d24-ac10-0b50535b017d tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] [instance: dcb1b50b-9e62-4ff3-9875-3d4635597b45] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:31:09.833956 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-a77433c8-c714-4d24-ac10-0b50535b017d tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:31:09.834494 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-a77433c8-c714-4d24-ac10-0b50535b017d tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:31:09.838803 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-a77433c8-c714-4d24-ac10-0b50535b017d tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:31:09.840283 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-a77433c8-c714-4d24-ac10-0b50535b017d tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:31:10.045358 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-542a5ef2-8329-4cd5-a28a-6180bc93abad tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a431c9708f4694bc0d514133e76088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a1921237622439bab89676e11477c13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:31:10.064281 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-542a5ef2-8329-4cd5-a28a-6180bc93abad tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] 10.222.0.33 "GET /compute/v2.1/servers/a3dbac58-662d-4720-8bcf-2300f9a9a5d1" status: 200 len: 1371 microversion: 2.1 time: 0.430782 Jul 18 10:31:10.065452 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 154/307] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:31:09 2022] GET /compute/v2.1/servers/a3dbac58-662d-4720-8bcf-2300f9a9a5d1 => generated 1371 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:31:10.084289 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-a77433c8-c714-4d24-ac10-0b50535b017d tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '986f90dfbad14324b3fffbd790d60a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e487deb7ff45bdbf2cc002d42d12a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:31:10.088085 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG dbcounter [-] [117880] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:31:10.094148 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-a77433c8-c714-4d24-ac10-0b50535b017d tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] 10.222.0.33 "GET /compute/v2.1/servers/dcb1b50b-9e62-4ff3-9875-3d4635597b45" status: 200 len: 1721 microversion: 2.1 time: 0.316515 Jul 18 10:31:10.094736 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 154/308] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:31:09 2022] GET /compute/v2.1/servers/dcb1b50b-9e62-4ff3-9875-3d4635597b45 => generated 1721 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:31:10.694751 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-0be10649-d0f9-4237-a3a3-4d3058095611 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:31:10.695351 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-0be10649-d0f9-4237-a3a3-4d3058095611 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] [instance: 1e3ca3fe-e03a-47e3-9d9c-a6ab431e2dd7] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:31:10.701685 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-0be10649-d0f9-4237-a3a3-4d3058095611 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:31:10.702127 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-0be10649-d0f9-4237-a3a3-4d3058095611 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:31:10.702873 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-0be10649-d0f9-4237-a3a3-4d3058095611 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:31:10.703346 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-0be10649-d0f9-4237-a3a3-4d3058095611 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:31:10.832134 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-0be10649-d0f9-4237-a3a3-4d3058095611 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f25c72896a2d4d619e5ad4b5a0a79aa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cf3d5bfe9a745f38372c42c9cfa1f63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:31:10.839471 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-0be10649-d0f9-4237-a3a3-4d3058095611 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] 10.222.0.33 "GET /compute/v2.1/servers/1e3ca3fe-e03a-47e3-9d9c-a6ab431e2dd7" status: 200 len: 1367 microversion: 2.1 time: 0.148473 Jul 18 10:31:10.840031 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 155/309] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:31:10 2022] GET /compute/v2.1/servers/1e3ca3fe-e03a-47e3-9d9c-a6ab431e2dd7 => generated 1367 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:31:11.081190 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-479c74c9-1644-405a-a649-9542db82f963 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:31:11.081743 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-479c74c9-1644-405a-a649-9542db82f963 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] [instance: a3dbac58-662d-4720-8bcf-2300f9a9a5d1] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:31:11.089504 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-479c74c9-1644-405a-a649-9542db82f963 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:31:11.089952 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-479c74c9-1644-405a-a649-9542db82f963 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:31:11.090713 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-479c74c9-1644-405a-a649-9542db82f963 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:31:11.091145 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-479c74c9-1644-405a-a649-9542db82f963 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:31:11.111718 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-c4799c27-a363-4256-b873-c6985d9e9e03 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:31:11.112322 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-c4799c27-a363-4256-b873-c6985d9e9e03 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] [instance: dcb1b50b-9e62-4ff3-9875-3d4635597b45] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:31:11.118229 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-c4799c27-a363-4256-b873-c6985d9e9e03 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:31:11.118704 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-c4799c27-a363-4256-b873-c6985d9e9e03 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:31:11.119457 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-c4799c27-a363-4256-b873-c6985d9e9e03 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:31:11.119889 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-c4799c27-a363-4256-b873-c6985d9e9e03 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:31:11.287645 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-479c74c9-1644-405a-a649-9542db82f963 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a431c9708f4694bc0d514133e76088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a1921237622439bab89676e11477c13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:31:11.294554 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-c4799c27-a363-4256-b873-c6985d9e9e03 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '986f90dfbad14324b3fffbd790d60a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e487deb7ff45bdbf2cc002d42d12a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:31:11.295336 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-479c74c9-1644-405a-a649-9542db82f963 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] 10.222.0.33 "GET /compute/v2.1/servers/a3dbac58-662d-4720-8bcf-2300f9a9a5d1" status: 200 len: 1371 microversion: 2.1 time: 0.218126 Jul 18 10:31:11.295910 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 155/310] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:31:11 2022] GET /compute/v2.1/servers/a3dbac58-662d-4720-8bcf-2300f9a9a5d1 => generated 1371 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:31:11.302614 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-c4799c27-a363-4256-b873-c6985d9e9e03 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] 10.222.0.33 "GET /compute/v2.1/servers/dcb1b50b-9e62-4ff3-9875-3d4635597b45" status: 200 len: 1721 microversion: 2.1 time: 0.195368 Jul 18 10:31:11.303166 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 156/311] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:31:11 2022] GET /compute/v2.1/servers/dcb1b50b-9e62-4ff3-9875-3d4635597b45 => generated 1721 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:31:11.857103 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-db386c16-61cf-402c-8e5e-6dfaa562093b tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:31:11.857638 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-db386c16-61cf-402c-8e5e-6dfaa562093b tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] [instance: 1e3ca3fe-e03a-47e3-9d9c-a6ab431e2dd7] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:31:11.864187 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-db386c16-61cf-402c-8e5e-6dfaa562093b tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:31:11.864679 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-db386c16-61cf-402c-8e5e-6dfaa562093b tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:31:11.865432 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-db386c16-61cf-402c-8e5e-6dfaa562093b tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:31:11.865861 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-db386c16-61cf-402c-8e5e-6dfaa562093b tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:31:11.995801 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-db386c16-61cf-402c-8e5e-6dfaa562093b tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f25c72896a2d4d619e5ad4b5a0a79aa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cf3d5bfe9a745f38372c42c9cfa1f63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:31:12.003177 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-db386c16-61cf-402c-8e5e-6dfaa562093b tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] 10.222.0.33 "GET /compute/v2.1/servers/1e3ca3fe-e03a-47e3-9d9c-a6ab431e2dd7" status: 200 len: 1367 microversion: 2.1 time: 0.150174 Jul 18 10:31:12.003731 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 156/312] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:31:11 2022] GET /compute/v2.1/servers/1e3ca3fe-e03a-47e3-9d9c-a6ab431e2dd7 => generated 1367 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:31:12.311167 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-c6adede1-061c-4f54-b28d-6b93322a780f tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:31:12.311770 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-c6adede1-061c-4f54-b28d-6b93322a780f tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] [instance: a3dbac58-662d-4720-8bcf-2300f9a9a5d1] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:31:12.319682 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-4a2da5f3-96f4-4089-a056-589748ee91f3 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:31:12.320681 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-c6adede1-061c-4f54-b28d-6b93322a780f tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:31:12.320875 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-4a2da5f3-96f4-4089-a056-589748ee91f3 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] [instance: dcb1b50b-9e62-4ff3-9875-3d4635597b45] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:31:12.321219 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-c6adede1-061c-4f54-b28d-6b93322a780f tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:31:12.322118 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-c6adede1-061c-4f54-b28d-6b93322a780f tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:31:12.322566 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-c6adede1-061c-4f54-b28d-6b93322a780f tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:31:12.327361 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-4a2da5f3-96f4-4089-a056-589748ee91f3 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:31:12.327808 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-4a2da5f3-96f4-4089-a056-589748ee91f3 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:31:12.329241 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-4a2da5f3-96f4-4089-a056-589748ee91f3 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:31:12.329676 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-4a2da5f3-96f4-4089-a056-589748ee91f3 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:31:12.513852 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-c6adede1-061c-4f54-b28d-6b93322a780f tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a431c9708f4694bc0d514133e76088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a1921237622439bab89676e11477c13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:31:12.521172 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-4a2da5f3-96f4-4089-a056-589748ee91f3 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '986f90dfbad14324b3fffbd790d60a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e487deb7ff45bdbf2cc002d42d12a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:31:12.528343 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-c6adede1-061c-4f54-b28d-6b93322a780f tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] 10.222.0.33 "GET /compute/v2.1/servers/a3dbac58-662d-4720-8bcf-2300f9a9a5d1" status: 200 len: 1371 microversion: 2.1 time: 0.220955 Jul 18 10:31:12.529173 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 157/313] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:31:12 2022] GET /compute/v2.1/servers/a3dbac58-662d-4720-8bcf-2300f9a9a5d1 => generated 1371 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:31:12.529293 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-4a2da5f3-96f4-4089-a056-589748ee91f3 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] 10.222.0.33 "GET /compute/v2.1/servers/dcb1b50b-9e62-4ff3-9875-3d4635597b45" status: 200 len: 1721 microversion: 2.1 time: 0.213513 Jul 18 10:31:12.534178 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 157/314] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:31:12 2022] GET /compute/v2.1/servers/dcb1b50b-9e62-4ff3-9875-3d4635597b45 => generated 1721 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:31:13.020029 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-98dbc12e-4db0-4c52-a988-2ec4e85b4650 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:31:13.020626 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-98dbc12e-4db0-4c52-a988-2ec4e85b4650 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] [instance: 1e3ca3fe-e03a-47e3-9d9c-a6ab431e2dd7] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:31:13.027004 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-98dbc12e-4db0-4c52-a988-2ec4e85b4650 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:31:13.027110 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-98dbc12e-4db0-4c52-a988-2ec4e85b4650 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:31:13.027835 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-98dbc12e-4db0-4c52-a988-2ec4e85b4650 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:31:13.028271 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-98dbc12e-4db0-4c52-a988-2ec4e85b4650 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:31:13.158282 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-98dbc12e-4db0-4c52-a988-2ec4e85b4650 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f25c72896a2d4d619e5ad4b5a0a79aa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cf3d5bfe9a745f38372c42c9cfa1f63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:31:13.165745 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-98dbc12e-4db0-4c52-a988-2ec4e85b4650 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] 10.222.0.33 "GET /compute/v2.1/servers/1e3ca3fe-e03a-47e3-9d9c-a6ab431e2dd7" status: 200 len: 1367 microversion: 2.1 time: 0.149635 Jul 18 10:31:13.166321 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 158/315] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:31:13 2022] GET /compute/v2.1/servers/1e3ca3fe-e03a-47e3-9d9c-a6ab431e2dd7 => generated 1367 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:31:13.545352 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-45a2b0ef-d595-45af-8df1-1e107023e51e tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:31:13.545939 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-45a2b0ef-d595-45af-8df1-1e107023e51e tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] [instance: a3dbac58-662d-4720-8bcf-2300f9a9a5d1] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:31:13.546045 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-e38b63f3-5df7-4d16-8e18-364391248085 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:31:13.546489 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-e38b63f3-5df7-4d16-8e18-364391248085 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] [instance: dcb1b50b-9e62-4ff3-9875-3d4635597b45] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:31:13.552848 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-45a2b0ef-d595-45af-8df1-1e107023e51e tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:31:13.554718 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-e38b63f3-5df7-4d16-8e18-364391248085 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:31:13.554853 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-45a2b0ef-d595-45af-8df1-1e107023e51e tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:31:13.554969 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-e38b63f3-5df7-4d16-8e18-364391248085 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:31:13.555063 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-45a2b0ef-d595-45af-8df1-1e107023e51e tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:31:13.555184 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-e38b63f3-5df7-4d16-8e18-364391248085 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:31:13.555278 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-45a2b0ef-d595-45af-8df1-1e107023e51e tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:31:13.555365 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-e38b63f3-5df7-4d16-8e18-364391248085 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:31:13.828809 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-45a2b0ef-d595-45af-8df1-1e107023e51e tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a431c9708f4694bc0d514133e76088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a1921237622439bab89676e11477c13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:31:13.832160 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-e38b63f3-5df7-4d16-8e18-364391248085 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '986f90dfbad14324b3fffbd790d60a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e487deb7ff45bdbf2cc002d42d12a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:31:13.837001 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-45a2b0ef-d595-45af-8df1-1e107023e51e tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] 10.222.0.33 "GET /compute/v2.1/servers/a3dbac58-662d-4720-8bcf-2300f9a9a5d1" status: 200 len: 1371 microversion: 2.1 time: 0.295727 Jul 18 10:31:13.839498 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG dbcounter [-] [117879] Writing DB stats nova_cell0:SELECT=4 {{(pid=117879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:31:13.843290 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-e38b63f3-5df7-4d16-8e18-364391248085 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] 10.222.0.33 "GET /compute/v2.1/servers/dcb1b50b-9e62-4ff3-9875-3d4635597b45" status: 200 len: 1721 microversion: 2.1 time: 0.301299 Jul 18 10:31:13.844794 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 159/316] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:31:13 2022] GET /compute/v2.1/servers/dcb1b50b-9e62-4ff3-9875-3d4635597b45 => generated 1721 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:31:13.847075 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 158/317] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:31:13 2022] GET /compute/v2.1/servers/a3dbac58-662d-4720-8bcf-2300f9a9a5d1 => generated 1371 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:31:14.193628 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-45049bba-2b4f-4731-b38a-0a11828d5c35 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:31:14.199948 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-45049bba-2b4f-4731-b38a-0a11828d5c35 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] [instance: 1e3ca3fe-e03a-47e3-9d9c-a6ab431e2dd7] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:31:14.204093 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG dbcounter [-] [117879] Writing DB stats nova_cell0:SELECT=16 {{(pid=117879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:31:14.211208 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-45049bba-2b4f-4731-b38a-0a11828d5c35 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:31:14.211674 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-45049bba-2b4f-4731-b38a-0a11828d5c35 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:31:14.212476 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-45049bba-2b4f-4731-b38a-0a11828d5c35 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:31:14.212892 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-45049bba-2b4f-4731-b38a-0a11828d5c35 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:31:14.482850 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-45049bba-2b4f-4731-b38a-0a11828d5c35 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f25c72896a2d4d619e5ad4b5a0a79aa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cf3d5bfe9a745f38372c42c9cfa1f63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:31:14.494787 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-45049bba-2b4f-4731-b38a-0a11828d5c35 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] 10.222.0.33 "GET /compute/v2.1/servers/1e3ca3fe-e03a-47e3-9d9c-a6ab431e2dd7" status: 200 len: 1367 microversion: 2.1 time: 0.313609 Jul 18 10:31:14.504323 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 160/318] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:31:14 2022] GET /compute/v2.1/servers/1e3ca3fe-e03a-47e3-9d9c-a6ab431e2dd7 => generated 1367 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:31:14.624922 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [req-c7a7fd9e-a724-4d90-a0b3-1bc0c46bb339 req-720cd416-32e3-48e2-a87f-2525fec9499a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a3dbac58-662d-4720-8bcf-2300f9a9a5d1", "tag": "280c18f2-df08-4a5c-a1cc-01a91c5d3cfb"}]} {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:31:14.628756 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG dbcounter [-] [117880] Writing DB stats nova_cell0:SELECT=8 {{(pid=117880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:31:14.648581 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [req-c7a7fd9e-a724-4d90-a0b3-1bc0c46bb339 req-720cd416-32e3-48e2-a87f-2525fec9499a service nova] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:31:14.649025 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [req-c7a7fd9e-a724-4d90-a0b3-1bc0c46bb339 req-720cd416-32e3-48e2-a87f-2525fec9499a service nova] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:31:14.682258 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.compute.server_external_events [req-c7a7fd9e-a724-4d90-a0b3-1bc0c46bb339 req-720cd416-32e3-48e2-a87f-2525fec9499a service nova] Creating event network-changed:280c18f2-df08-4a5c-a1cc-01a91c5d3cfb for instance a3dbac58-662d-4720-8bcf-2300f9a9a5d1 on hv-cinder-83754 Jul 18 10:31:14.696111 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [req-c7a7fd9e-a724-4d90-a0b3-1bc0c46bb339 req-720cd416-32e3-48e2-a87f-2525fec9499a service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080435 Jul 18 10:31:14.696827 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 159/319] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jul 18 10:31:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:31:14.855014 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-a9f2fb2b-bcaf-4e56-9de7-3b94082551d5 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:31:14.856193 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-a9f2fb2b-bcaf-4e56-9de7-3b94082551d5 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] [instance: a3dbac58-662d-4720-8bcf-2300f9a9a5d1] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:31:14.863847 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-abd557d6-426e-4f8a-96ff-7b060df5e39c tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:31:14.864785 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-a9f2fb2b-bcaf-4e56-9de7-3b94082551d5 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:31:14.864918 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-abd557d6-426e-4f8a-96ff-7b060df5e39c tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] [instance: dcb1b50b-9e62-4ff3-9875-3d4635597b45] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:31:14.865506 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-a9f2fb2b-bcaf-4e56-9de7-3b94082551d5 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:31:14.866540 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-a9f2fb2b-bcaf-4e56-9de7-3b94082551d5 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:31:14.867186 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-a9f2fb2b-bcaf-4e56-9de7-3b94082551d5 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:31:14.882033 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-abd557d6-426e-4f8a-96ff-7b060df5e39c tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:31:14.882898 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-abd557d6-426e-4f8a-96ff-7b060df5e39c tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:31:14.883748 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-abd557d6-426e-4f8a-96ff-7b060df5e39c tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:31:14.884194 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-abd557d6-426e-4f8a-96ff-7b060df5e39c tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:31:15.240145 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-abd557d6-426e-4f8a-96ff-7b060df5e39c tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '986f90dfbad14324b3fffbd790d60a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e487deb7ff45bdbf2cc002d42d12a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:31:15.244268 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-a9f2fb2b-bcaf-4e56-9de7-3b94082551d5 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a431c9708f4694bc0d514133e76088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a1921237622439bab89676e11477c13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:31:15.249877 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-abd557d6-426e-4f8a-96ff-7b060df5e39c tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] 10.222.0.33 "GET /compute/v2.1/servers/dcb1b50b-9e62-4ff3-9875-3d4635597b45" status: 200 len: 1721 microversion: 2.1 time: 0.390549 Jul 18 10:31:15.251751 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 160/320] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:31:14 2022] GET /compute/v2.1/servers/dcb1b50b-9e62-4ff3-9875-3d4635597b45 => generated 1721 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:31:15.260005 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-a9f2fb2b-bcaf-4e56-9de7-3b94082551d5 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] 10.222.0.33 "GET /compute/v2.1/servers/a3dbac58-662d-4720-8bcf-2300f9a9a5d1" status: 200 len: 1371 microversion: 2.1 time: 0.409339 Jul 18 10:31:15.261249 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 161/321] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:31:14 2022] GET /compute/v2.1/servers/a3dbac58-662d-4720-8bcf-2300f9a9a5d1 => generated 1371 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:31:15.520906 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-962793d9-5339-432d-9361-8284cd32840e tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:31:15.521598 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-962793d9-5339-432d-9361-8284cd32840e tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] [instance: 1e3ca3fe-e03a-47e3-9d9c-a6ab431e2dd7] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:31:15.527933 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-962793d9-5339-432d-9361-8284cd32840e tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:31:15.528447 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-962793d9-5339-432d-9361-8284cd32840e tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:31:15.529357 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-962793d9-5339-432d-9361-8284cd32840e tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:31:15.529861 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-962793d9-5339-432d-9361-8284cd32840e tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:31:15.659143 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-962793d9-5339-432d-9361-8284cd32840e tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f25c72896a2d4d619e5ad4b5a0a79aa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cf3d5bfe9a745f38372c42c9cfa1f63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:31:15.666709 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-962793d9-5339-432d-9361-8284cd32840e tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] 10.222.0.33 "GET /compute/v2.1/servers/1e3ca3fe-e03a-47e3-9d9c-a6ab431e2dd7" status: 200 len: 1367 microversion: 2.1 time: 0.149524 Jul 18 10:31:15.667272 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 161/322] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:31:15 2022] GET /compute/v2.1/servers/1e3ca3fe-e03a-47e3-9d9c-a6ab431e2dd7 => generated 1367 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:31:16.267188 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-1e003d03-2eb5-43c7-964a-5fe112d9e9b8 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:31:16.267718 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-1e003d03-2eb5-43c7-964a-5fe112d9e9b8 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] [instance: dcb1b50b-9e62-4ff3-9875-3d4635597b45] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:31:16.274082 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-1e003d03-2eb5-43c7-964a-5fe112d9e9b8 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:31:16.274531 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-1e003d03-2eb5-43c7-964a-5fe112d9e9b8 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:31:16.275291 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-1e003d03-2eb5-43c7-964a-5fe112d9e9b8 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:31:16.275722 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-1e003d03-2eb5-43c7-964a-5fe112d9e9b8 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:31:16.276444 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-c31e4d11-81c5-4013-83de-3d62018b9bdf tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:31:16.277085 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-c31e4d11-81c5-4013-83de-3d62018b9bdf tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] [instance: a3dbac58-662d-4720-8bcf-2300f9a9a5d1] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:31:16.283467 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-c31e4d11-81c5-4013-83de-3d62018b9bdf tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:31:16.283918 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-c31e4d11-81c5-4013-83de-3d62018b9bdf tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:31:16.284761 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-c31e4d11-81c5-4013-83de-3d62018b9bdf tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:31:16.285198 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-c31e4d11-81c5-4013-83de-3d62018b9bdf tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:31:16.479340 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-1e003d03-2eb5-43c7-964a-5fe112d9e9b8 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '986f90dfbad14324b3fffbd790d60a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e487deb7ff45bdbf2cc002d42d12a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:31:16.483278 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-c31e4d11-81c5-4013-83de-3d62018b9bdf tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a431c9708f4694bc0d514133e76088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a1921237622439bab89676e11477c13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:31:16.487339 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-1e003d03-2eb5-43c7-964a-5fe112d9e9b8 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] 10.222.0.33 "GET /compute/v2.1/servers/dcb1b50b-9e62-4ff3-9875-3d4635597b45" status: 200 len: 1721 microversion: 2.1 time: 0.224055 Jul 18 10:31:16.487906 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 162/323] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:31:16 2022] GET /compute/v2.1/servers/dcb1b50b-9e62-4ff3-9875-3d4635597b45 => generated 1721 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:31:16.490690 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-c31e4d11-81c5-4013-83de-3d62018b9bdf tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] 10.222.0.33 "GET /compute/v2.1/servers/a3dbac58-662d-4720-8bcf-2300f9a9a5d1" status: 200 len: 1371 microversion: 2.1 time: 0.218132 Jul 18 10:31:16.491235 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 162/324] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:31:16 2022] GET /compute/v2.1/servers/a3dbac58-662d-4720-8bcf-2300f9a9a5d1 => generated 1371 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:31:16.683601 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-01bdda40-e098-45d2-af00-e33f8ebbfaf8 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:31:16.684214 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-01bdda40-e098-45d2-af00-e33f8ebbfaf8 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] [instance: 1e3ca3fe-e03a-47e3-9d9c-a6ab431e2dd7] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:31:16.691056 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-01bdda40-e098-45d2-af00-e33f8ebbfaf8 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:31:16.691505 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-01bdda40-e098-45d2-af00-e33f8ebbfaf8 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:31:16.692303 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-01bdda40-e098-45d2-af00-e33f8ebbfaf8 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:31:16.692768 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-01bdda40-e098-45d2-af00-e33f8ebbfaf8 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:31:16.821217 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-01bdda40-e098-45d2-af00-e33f8ebbfaf8 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f25c72896a2d4d619e5ad4b5a0a79aa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cf3d5bfe9a745f38372c42c9cfa1f63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:31:16.828475 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-01bdda40-e098-45d2-af00-e33f8ebbfaf8 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] 10.222.0.33 "GET /compute/v2.1/servers/1e3ca3fe-e03a-47e3-9d9c-a6ab431e2dd7" status: 200 len: 1367 microversion: 2.1 time: 0.149139 Jul 18 10:31:16.829066 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 163/325] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:31:16 2022] GET /compute/v2.1/servers/1e3ca3fe-e03a-47e3-9d9c-a6ab431e2dd7 => generated 1367 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:31:17.505711 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-c25348fb-3a96-47a2-8d25-c303008a5a06 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:31:17.506346 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-c25348fb-3a96-47a2-8d25-c303008a5a06 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] [instance: dcb1b50b-9e62-4ff3-9875-3d4635597b45] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:31:17.506763 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-0a7cae20-35a5-48e7-8276-3bf0255016e6 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:31:17.507292 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-0a7cae20-35a5-48e7-8276-3bf0255016e6 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] [instance: a3dbac58-662d-4720-8bcf-2300f9a9a5d1] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:31:17.513263 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-c25348fb-3a96-47a2-8d25-c303008a5a06 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:31:17.513718 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-c25348fb-3a96-47a2-8d25-c303008a5a06 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:31:17.514110 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-0a7cae20-35a5-48e7-8276-3bf0255016e6 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:31:17.514484 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-c25348fb-3a96-47a2-8d25-c303008a5a06 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:31:17.514585 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-0a7cae20-35a5-48e7-8276-3bf0255016e6 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:31:17.514915 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-c25348fb-3a96-47a2-8d25-c303008a5a06 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:31:17.515301 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-0a7cae20-35a5-48e7-8276-3bf0255016e6 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:31:17.516387 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-0a7cae20-35a5-48e7-8276-3bf0255016e6 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:31:17.708452 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-c25348fb-3a96-47a2-8d25-c303008a5a06 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '986f90dfbad14324b3fffbd790d60a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e487deb7ff45bdbf2cc002d42d12a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:31:17.711464 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-0a7cae20-35a5-48e7-8276-3bf0255016e6 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a431c9708f4694bc0d514133e76088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a1921237622439bab89676e11477c13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:31:17.716524 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-c25348fb-3a96-47a2-8d25-c303008a5a06 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] 10.222.0.33 "GET /compute/v2.1/servers/dcb1b50b-9e62-4ff3-9875-3d4635597b45" status: 200 len: 1721 microversion: 2.1 time: 0.215213 Jul 18 10:31:17.717095 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 163/326] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:31:17 2022] GET /compute/v2.1/servers/dcb1b50b-9e62-4ff3-9875-3d4635597b45 => generated 1721 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:31:17.718688 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-0a7cae20-35a5-48e7-8276-3bf0255016e6 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] 10.222.0.33 "GET /compute/v2.1/servers/a3dbac58-662d-4720-8bcf-2300f9a9a5d1" status: 200 len: 1371 microversion: 2.1 time: 0.215690 Jul 18 10:31:17.719325 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 164/327] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:31:17 2022] GET /compute/v2.1/servers/a3dbac58-662d-4720-8bcf-2300f9a9a5d1 => generated 1371 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:31:17.845047 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-40891062-532b-4dd9-8fb8-ebbf2a6290e6 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:31:17.845673 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-40891062-532b-4dd9-8fb8-ebbf2a6290e6 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] [instance: 1e3ca3fe-e03a-47e3-9d9c-a6ab431e2dd7] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:31:17.851536 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-40891062-532b-4dd9-8fb8-ebbf2a6290e6 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:31:17.851986 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-40891062-532b-4dd9-8fb8-ebbf2a6290e6 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:31:17.852771 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-40891062-532b-4dd9-8fb8-ebbf2a6290e6 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:31:17.853470 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-40891062-532b-4dd9-8fb8-ebbf2a6290e6 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:31:17.980801 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-40891062-532b-4dd9-8fb8-ebbf2a6290e6 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f25c72896a2d4d619e5ad4b5a0a79aa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cf3d5bfe9a745f38372c42c9cfa1f63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:31:17.988120 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-40891062-532b-4dd9-8fb8-ebbf2a6290e6 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] 10.222.0.33 "GET /compute/v2.1/servers/1e3ca3fe-e03a-47e3-9d9c-a6ab431e2dd7" status: 200 len: 1367 microversion: 2.1 time: 0.146778 Jul 18 10:31:17.988710 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 164/328] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:31:17 2022] GET /compute/v2.1/servers/1e3ca3fe-e03a-47e3-9d9c-a6ab431e2dd7 => generated 1367 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:31:18.733808 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-046626e1-86c7-4378-ab26-af15e454a6be tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:31:18.734916 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-046626e1-86c7-4378-ab26-af15e454a6be tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] [instance: dcb1b50b-9e62-4ff3-9875-3d4635597b45] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:31:18.735333 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-ef9ecb0c-7ac5-4096-bf8d-61d7c2718f5f tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:31:18.735947 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-ef9ecb0c-7ac5-4096-bf8d-61d7c2718f5f tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] [instance: a3dbac58-662d-4720-8bcf-2300f9a9a5d1] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:31:18.737241 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG dbcounter [-] [117879] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=117879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:31:18.742365 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-046626e1-86c7-4378-ab26-af15e454a6be tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:31:18.742684 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-ef9ecb0c-7ac5-4096-bf8d-61d7c2718f5f tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:31:18.742810 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-046626e1-86c7-4378-ab26-af15e454a6be tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:31:18.743137 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-ef9ecb0c-7ac5-4096-bf8d-61d7c2718f5f tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:31:18.743567 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-046626e1-86c7-4378-ab26-af15e454a6be tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:31:18.743899 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-ef9ecb0c-7ac5-4096-bf8d-61d7c2718f5f tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:31:18.744046 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-046626e1-86c7-4378-ab26-af15e454a6be tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:31:18.744438 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-ef9ecb0c-7ac5-4096-bf8d-61d7c2718f5f tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:31:18.935677 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-046626e1-86c7-4378-ab26-af15e454a6be tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '986f90dfbad14324b3fffbd790d60a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e487deb7ff45bdbf2cc002d42d12a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:31:18.940332 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-ef9ecb0c-7ac5-4096-bf8d-61d7c2718f5f tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a431c9708f4694bc0d514133e76088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a1921237622439bab89676e11477c13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:31:18.944185 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-046626e1-86c7-4378-ab26-af15e454a6be tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] 10.222.0.33 "GET /compute/v2.1/servers/dcb1b50b-9e62-4ff3-9875-3d4635597b45" status: 200 len: 1721 microversion: 2.1 time: 0.214257 Jul 18 10:31:18.944800 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 165/329] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:31:18 2022] GET /compute/v2.1/servers/dcb1b50b-9e62-4ff3-9875-3d4635597b45 => generated 1721 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:31:18.948802 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-ef9ecb0c-7ac5-4096-bf8d-61d7c2718f5f tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] 10.222.0.33 "GET /compute/v2.1/servers/a3dbac58-662d-4720-8bcf-2300f9a9a5d1" status: 200 len: 1371 microversion: 2.1 time: 0.217733 Jul 18 10:31:18.949351 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 165/330] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:31:18 2022] GET /compute/v2.1/servers/a3dbac58-662d-4720-8bcf-2300f9a9a5d1 => generated 1371 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:31:19.005249 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-906df177-99e1-4ebc-b851-5f6d4f4eec40 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:31:19.005858 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-906df177-99e1-4ebc-b851-5f6d4f4eec40 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] [instance: 1e3ca3fe-e03a-47e3-9d9c-a6ab431e2dd7] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:31:19.011755 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-906df177-99e1-4ebc-b851-5f6d4f4eec40 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:31:19.012209 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-906df177-99e1-4ebc-b851-5f6d4f4eec40 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:31:19.013023 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-906df177-99e1-4ebc-b851-5f6d4f4eec40 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:31:19.013464 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-906df177-99e1-4ebc-b851-5f6d4f4eec40 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:31:19.153788 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-906df177-99e1-4ebc-b851-5f6d4f4eec40 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f25c72896a2d4d619e5ad4b5a0a79aa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cf3d5bfe9a745f38372c42c9cfa1f63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:31:19.162625 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-906df177-99e1-4ebc-b851-5f6d4f4eec40 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] 10.222.0.33 "GET /compute/v2.1/servers/1e3ca3fe-e03a-47e3-9d9c-a6ab431e2dd7" status: 200 len: 1367 microversion: 2.1 time: 0.160979 Jul 18 10:31:19.163403 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 166/331] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:31:18 2022] GET /compute/v2.1/servers/1e3ca3fe-e03a-47e3-9d9c-a6ab431e2dd7 => generated 1367 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:31:19.960134 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-777e5760-74f0-4b94-b350-6531ace73d7f tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:31:19.960775 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-777e5760-74f0-4b94-b350-6531ace73d7f tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] [instance: dcb1b50b-9e62-4ff3-9875-3d4635597b45] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:31:19.965673 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-b86b66f7-aae9-47f0-b901-5811770b7fc1 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:31:19.966279 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-b86b66f7-aae9-47f0-b901-5811770b7fc1 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] [instance: a3dbac58-662d-4720-8bcf-2300f9a9a5d1] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:31:19.967472 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-777e5760-74f0-4b94-b350-6531ace73d7f tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:31:19.967925 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-777e5760-74f0-4b94-b350-6531ace73d7f tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:31:19.969226 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-777e5760-74f0-4b94-b350-6531ace73d7f tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:31:19.969718 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-777e5760-74f0-4b94-b350-6531ace73d7f tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:31:19.973250 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-b86b66f7-aae9-47f0-b901-5811770b7fc1 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:31:19.973698 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-b86b66f7-aae9-47f0-b901-5811770b7fc1 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:31:19.974462 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-b86b66f7-aae9-47f0-b901-5811770b7fc1 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:31:19.974897 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-b86b66f7-aae9-47f0-b901-5811770b7fc1 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:31:20.172373 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-b86b66f7-aae9-47f0-b901-5811770b7fc1 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a431c9708f4694bc0d514133e76088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a1921237622439bab89676e11477c13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:31:20.179975 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-777e5760-74f0-4b94-b350-6531ace73d7f tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '986f90dfbad14324b3fffbd790d60a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e487deb7ff45bdbf2cc002d42d12a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:31:20.186826 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-b86b66f7-aae9-47f0-b901-5811770b7fc1 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] 10.222.0.33 "GET /compute/v2.1/servers/a3dbac58-662d-4720-8bcf-2300f9a9a5d1" status: 200 len: 1371 microversion: 2.1 time: 0.224861 Jul 18 10:31:20.187404 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 167/332] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:31:19 2022] GET /compute/v2.1/servers/a3dbac58-662d-4720-8bcf-2300f9a9a5d1 => generated 1371 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:31:20.188381 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-777e5760-74f0-4b94-b350-6531ace73d7f tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] 10.222.0.33 "GET /compute/v2.1/servers/dcb1b50b-9e62-4ff3-9875-3d4635597b45" status: 200 len: 1721 microversion: 2.1 time: 0.232047 Jul 18 10:31:20.189116 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 166/333] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:31:19 2022] GET /compute/v2.1/servers/dcb1b50b-9e62-4ff3-9875-3d4635597b45 => generated 1721 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:31:20.210472 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-74d223d7-981a-45ab-99b6-e485cd26e631 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:31:20.211094 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-74d223d7-981a-45ab-99b6-e485cd26e631 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] [instance: 1e3ca3fe-e03a-47e3-9d9c-a6ab431e2dd7] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:31:20.217500 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-74d223d7-981a-45ab-99b6-e485cd26e631 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:31:20.217924 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-74d223d7-981a-45ab-99b6-e485cd26e631 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:31:20.219273 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-74d223d7-981a-45ab-99b6-e485cd26e631 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:31:20.219907 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-74d223d7-981a-45ab-99b6-e485cd26e631 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:31:20.399239 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-74d223d7-981a-45ab-99b6-e485cd26e631 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f25c72896a2d4d619e5ad4b5a0a79aa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cf3d5bfe9a745f38372c42c9cfa1f63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:31:20.403414 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG dbcounter [-] [117879] Writing DB stats nova_cell1:SELECT=100 {{(pid=117879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:31:20.409890 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-74d223d7-981a-45ab-99b6-e485cd26e631 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] 10.222.0.33 "GET /compute/v2.1/servers/1e3ca3fe-e03a-47e3-9d9c-a6ab431e2dd7" status: 200 len: 1367 microversion: 2.1 time: 0.208218 Jul 18 10:31:20.410589 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 168/334] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:31:20 2022] GET /compute/v2.1/servers/1e3ca3fe-e03a-47e3-9d9c-a6ab431e2dd7 => generated 1367 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:31:21.202831 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-ea4811d9-8ffd-4bbc-97b7-3c8789583307 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:31:21.203464 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-ea4811d9-8ffd-4bbc-97b7-3c8789583307 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] [instance: a3dbac58-662d-4720-8bcf-2300f9a9a5d1] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:31:21.209887 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-ea4811d9-8ffd-4bbc-97b7-3c8789583307 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:31:21.210335 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-ea4811d9-8ffd-4bbc-97b7-3c8789583307 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:31:21.211087 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-ea4811d9-8ffd-4bbc-97b7-3c8789583307 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:31:21.211511 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-ea4811d9-8ffd-4bbc-97b7-3c8789583307 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:31:21.215932 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-887feb56-1648-4b54-bd9b-22715005433c tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:31:21.216564 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-887feb56-1648-4b54-bd9b-22715005433c tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] [instance: dcb1b50b-9e62-4ff3-9875-3d4635597b45] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:31:21.223074 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-887feb56-1648-4b54-bd9b-22715005433c tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:31:21.223530 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-887feb56-1648-4b54-bd9b-22715005433c tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:31:21.224295 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-887feb56-1648-4b54-bd9b-22715005433c tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:31:21.224835 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-887feb56-1648-4b54-bd9b-22715005433c tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:31:21.403670 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-ea4811d9-8ffd-4bbc-97b7-3c8789583307 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a431c9708f4694bc0d514133e76088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a1921237622439bab89676e11477c13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:31:21.412301 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-ea4811d9-8ffd-4bbc-97b7-3c8789583307 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] 10.222.0.33 "GET /compute/v2.1/servers/a3dbac58-662d-4720-8bcf-2300f9a9a5d1" status: 200 len: 1371 microversion: 2.1 time: 0.213155 Jul 18 10:31:21.412890 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 167/335] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:31:21 2022] GET /compute/v2.1/servers/a3dbac58-662d-4720-8bcf-2300f9a9a5d1 => generated 1371 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:31:21.428161 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-deb6c83d-7f9b-4f54-a78a-3d4bc2ee59f0 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:31:21.428852 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-887feb56-1648-4b54-bd9b-22715005433c tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '986f90dfbad14324b3fffbd790d60a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e487deb7ff45bdbf2cc002d42d12a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:31:21.429000 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-deb6c83d-7f9b-4f54-a78a-3d4bc2ee59f0 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] [instance: 1e3ca3fe-e03a-47e3-9d9c-a6ab431e2dd7] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:31:21.435328 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-deb6c83d-7f9b-4f54-a78a-3d4bc2ee59f0 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:31:21.435782 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-deb6c83d-7f9b-4f54-a78a-3d4bc2ee59f0 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:31:21.436598 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-deb6c83d-7f9b-4f54-a78a-3d4bc2ee59f0 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:31:21.437036 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-deb6c83d-7f9b-4f54-a78a-3d4bc2ee59f0 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:31:21.438877 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-887feb56-1648-4b54-bd9b-22715005433c tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] 10.222.0.33 "GET /compute/v2.1/servers/dcb1b50b-9e62-4ff3-9875-3d4635597b45" status: 200 len: 1721 microversion: 2.1 time: 0.226660 Jul 18 10:31:21.439687 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 169/336] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:31:21 2022] GET /compute/v2.1/servers/dcb1b50b-9e62-4ff3-9875-3d4635597b45 => generated 1721 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:31:21.572791 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-deb6c83d-7f9b-4f54-a78a-3d4bc2ee59f0 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f25c72896a2d4d619e5ad4b5a0a79aa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cf3d5bfe9a745f38372c42c9cfa1f63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:31:21.580768 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-deb6c83d-7f9b-4f54-a78a-3d4bc2ee59f0 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] 10.222.0.33 "GET /compute/v2.1/servers/1e3ca3fe-e03a-47e3-9d9c-a6ab431e2dd7" status: 200 len: 1367 microversion: 2.1 time: 0.156463 Jul 18 10:31:21.581323 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 168/337] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:31:21 2022] GET /compute/v2.1/servers/1e3ca3fe-e03a-47e3-9d9c-a6ab431e2dd7 => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:31:22.428758 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-98ec2aa5-8f9e-4e4b-aedb-264b3b62d4ee tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:31:22.429480 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-98ec2aa5-8f9e-4e4b-aedb-264b3b62d4ee tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] [instance: a3dbac58-662d-4720-8bcf-2300f9a9a5d1] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:31:22.435741 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-98ec2aa5-8f9e-4e4b-aedb-264b3b62d4ee tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:31:22.436194 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-98ec2aa5-8f9e-4e4b-aedb-264b3b62d4ee tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:31:22.436991 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-98ec2aa5-8f9e-4e4b-aedb-264b3b62d4ee tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:31:22.437527 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-98ec2aa5-8f9e-4e4b-aedb-264b3b62d4ee tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:31:22.454995 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-1be6a654-1e3d-4fdf-818f-19431df10c6a tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:31:22.455700 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-1be6a654-1e3d-4fdf-818f-19431df10c6a tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] [instance: dcb1b50b-9e62-4ff3-9875-3d4635597b45] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:31:22.462076 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-1be6a654-1e3d-4fdf-818f-19431df10c6a tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:31:22.462627 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-1be6a654-1e3d-4fdf-818f-19431df10c6a tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:31:22.463393 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-1be6a654-1e3d-4fdf-818f-19431df10c6a tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:31:22.463823 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-1be6a654-1e3d-4fdf-818f-19431df10c6a tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:31:22.629497 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-98ec2aa5-8f9e-4e4b-aedb-264b3b62d4ee tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a431c9708f4694bc0d514133e76088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a1921237622439bab89676e11477c13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:31:22.636712 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-98ec2aa5-8f9e-4e4b-aedb-264b3b62d4ee tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] 10.222.0.33 "GET /compute/v2.1/servers/a3dbac58-662d-4720-8bcf-2300f9a9a5d1" status: 200 len: 1371 microversion: 2.1 time: 0.211750 Jul 18 10:31:22.637337 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 170/338] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:31:22 2022] GET /compute/v2.1/servers/a3dbac58-662d-4720-8bcf-2300f9a9a5d1 => generated 1371 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:31:22.643575 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-3581f67c-07aa-4442-835f-8bf5571492f7 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:31:22.644020 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-1be6a654-1e3d-4fdf-818f-19431df10c6a tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '986f90dfbad14324b3fffbd790d60a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e487deb7ff45bdbf2cc002d42d12a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:31:22.644403 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-3581f67c-07aa-4442-835f-8bf5571492f7 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] [instance: 1e3ca3fe-e03a-47e3-9d9c-a6ab431e2dd7] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:31:22.650656 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-3581f67c-07aa-4442-835f-8bf5571492f7 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:31:22.651137 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-3581f67c-07aa-4442-835f-8bf5571492f7 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:31:22.651978 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-3581f67c-07aa-4442-835f-8bf5571492f7 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:31:22.652241 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-1be6a654-1e3d-4fdf-818f-19431df10c6a tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] 10.222.0.33 "GET /compute/v2.1/servers/dcb1b50b-9e62-4ff3-9875-3d4635597b45" status: 200 len: 1721 microversion: 2.1 time: 0.201059 Jul 18 10:31:22.652839 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-3581f67c-07aa-4442-835f-8bf5571492f7 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:31:22.653155 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 169/339] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:31:22 2022] GET /compute/v2.1/servers/dcb1b50b-9e62-4ff3-9875-3d4635597b45 => generated 1721 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:31:22.779856 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-3581f67c-07aa-4442-835f-8bf5571492f7 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f25c72896a2d4d619e5ad4b5a0a79aa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cf3d5bfe9a745f38372c42c9cfa1f63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:31:22.787269 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-3581f67c-07aa-4442-835f-8bf5571492f7 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] 10.222.0.33 "GET /compute/v2.1/servers/1e3ca3fe-e03a-47e3-9d9c-a6ab431e2dd7" status: 200 len: 1367 microversion: 2.1 time: 0.149068 Jul 18 10:31:22.788022 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 171/340] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:31:22 2022] GET /compute/v2.1/servers/1e3ca3fe-e03a-47e3-9d9c-a6ab431e2dd7 => generated 1367 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:31:23.654020 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-8859b976-aa8d-4246-a609-48c9a4cc680b tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:31:23.654689 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-8859b976-aa8d-4246-a609-48c9a4cc680b tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] [instance: a3dbac58-662d-4720-8bcf-2300f9a9a5d1] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:31:23.661447 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-8859b976-aa8d-4246-a609-48c9a4cc680b tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:31:23.661929 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-8859b976-aa8d-4246-a609-48c9a4cc680b tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:31:23.662694 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-8859b976-aa8d-4246-a609-48c9a4cc680b tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:31:23.663133 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-8859b976-aa8d-4246-a609-48c9a4cc680b tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:31:23.671120 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-390d1344-1d75-4904-8946-be925ad9a8d8 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:31:23.671738 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-390d1344-1d75-4904-8946-be925ad9a8d8 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] [instance: dcb1b50b-9e62-4ff3-9875-3d4635597b45] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:31:23.679146 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-390d1344-1d75-4904-8946-be925ad9a8d8 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:31:23.679721 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-390d1344-1d75-4904-8946-be925ad9a8d8 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:31:23.680696 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-390d1344-1d75-4904-8946-be925ad9a8d8 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:31:23.681206 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-390d1344-1d75-4904-8946-be925ad9a8d8 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:31:23.883954 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-8859b976-aa8d-4246-a609-48c9a4cc680b tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a431c9708f4694bc0d514133e76088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a1921237622439bab89676e11477c13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:31:23.895356 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-390d1344-1d75-4904-8946-be925ad9a8d8 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '986f90dfbad14324b3fffbd790d60a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e487deb7ff45bdbf2cc002d42d12a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:31:23.897544 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-8859b976-aa8d-4246-a609-48c9a4cc680b tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] 10.222.0.33 "GET /compute/v2.1/servers/a3dbac58-662d-4720-8bcf-2300f9a9a5d1" status: 200 len: 1371 microversion: 2.1 time: 0.247505 Jul 18 10:31:23.898270 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 170/341] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:31:23 2022] GET /compute/v2.1/servers/a3dbac58-662d-4720-8bcf-2300f9a9a5d1 => generated 1371 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:31:23.902914 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-129724a0-d8fa-44d4-bb6f-ecbbb9aae4d3 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:31:23.903730 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-129724a0-d8fa-44d4-bb6f-ecbbb9aae4d3 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] [instance: 1e3ca3fe-e03a-47e3-9d9c-a6ab431e2dd7] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:31:23.909112 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-390d1344-1d75-4904-8946-be925ad9a8d8 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] 10.222.0.33 "GET /compute/v2.1/servers/dcb1b50b-9e62-4ff3-9875-3d4635597b45" status: 200 len: 1721 microversion: 2.1 time: 0.240802 Jul 18 10:31:23.910085 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 172/342] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:31:23 2022] GET /compute/v2.1/servers/dcb1b50b-9e62-4ff3-9875-3d4635597b45 => generated 1721 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:31:23.920422 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-129724a0-d8fa-44d4-bb6f-ecbbb9aae4d3 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:31:23.920929 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-129724a0-d8fa-44d4-bb6f-ecbbb9aae4d3 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:31:23.921826 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-129724a0-d8fa-44d4-bb6f-ecbbb9aae4d3 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:31:23.922268 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-129724a0-d8fa-44d4-bb6f-ecbbb9aae4d3 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:31:23.947858 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [req-6daa970d-0df8-4da7-b617-aefd66feb86f req-98837af5-8842-4dfb-9398-e7406ffc423a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e3ca3fe-e03a-47e3-9d9c-a6ab431e2dd7", "name": "network-vif-plugged", "status": "completed", "tag": "45d07fc3-9cad-4182-885d-f3a4c1ec9917"}]} {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:31:23.957545 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [req-6daa970d-0df8-4da7-b617-aefd66feb86f req-98837af5-8842-4dfb-9398-e7406ffc423a service nova] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:31:23.958535 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [req-6daa970d-0df8-4da7-b617-aefd66feb86f req-98837af5-8842-4dfb-9398-e7406ffc423a service nova] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:31:23.976840 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.compute.server_external_events [req-6daa970d-0df8-4da7-b617-aefd66feb86f req-98837af5-8842-4dfb-9398-e7406ffc423a service nova] Creating event network-vif-plugged:45d07fc3-9cad-4182-885d-f3a4c1ec9917 for instance 1e3ca3fe-e03a-47e3-9d9c-a6ab431e2dd7 on hv-cinder-83754 Jul 18 10:31:23.984813 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [req-6daa970d-0df8-4da7-b617-aefd66feb86f req-98837af5-8842-4dfb-9398-e7406ffc423a service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040844 Jul 18 10:31:23.986654 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 173/343] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jul 18 10:31:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 10:31:24.109576 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-129724a0-d8fa-44d4-bb6f-ecbbb9aae4d3 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f25c72896a2d4d619e5ad4b5a0a79aa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cf3d5bfe9a745f38372c42c9cfa1f63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:31:24.119722 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-129724a0-d8fa-44d4-bb6f-ecbbb9aae4d3 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] 10.222.0.33 "GET /compute/v2.1/servers/1e3ca3fe-e03a-47e3-9d9c-a6ab431e2dd7" status: 200 len: 1367 microversion: 2.1 time: 0.220435 Jul 18 10:31:24.120794 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 171/344] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:31:23 2022] GET /compute/v2.1/servers/1e3ca3fe-e03a-47e3-9d9c-a6ab431e2dd7 => generated 1367 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:31:24.916290 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-5ea4bef3-1218-43ff-a56a-29631fd38104 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:31:24.917019 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-5ea4bef3-1218-43ff-a56a-29631fd38104 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] [instance: a3dbac58-662d-4720-8bcf-2300f9a9a5d1] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:31:24.925777 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-23f5ff57-287f-429c-8ad0-b3a5862399f4 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:31:24.926379 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-23f5ff57-287f-429c-8ad0-b3a5862399f4 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] [instance: dcb1b50b-9e62-4ff3-9875-3d4635597b45] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:31:24.932481 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-23f5ff57-287f-429c-8ad0-b3a5862399f4 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:31:24.932950 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-23f5ff57-287f-429c-8ad0-b3a5862399f4 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:31:24.933702 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-23f5ff57-287f-429c-8ad0-b3a5862399f4 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:31:24.934127 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-23f5ff57-287f-429c-8ad0-b3a5862399f4 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:31:24.938090 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG dbcounter [-] [117880] Writing DB stats nova_cell1:SELECT=100 {{(pid=117880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:31:24.942179 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-5ea4bef3-1218-43ff-a56a-29631fd38104 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:31:24.942621 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-5ea4bef3-1218-43ff-a56a-29631fd38104 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:31:24.943570 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-5ea4bef3-1218-43ff-a56a-29631fd38104 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:31:24.944165 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-5ea4bef3-1218-43ff-a56a-29631fd38104 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:31:25.159031 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-23f5ff57-287f-429c-8ad0-b3a5862399f4 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '986f90dfbad14324b3fffbd790d60a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e487deb7ff45bdbf2cc002d42d12a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:31:25.168325 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-23f5ff57-287f-429c-8ad0-b3a5862399f4 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] 10.222.0.33 "GET /compute/v2.1/servers/dcb1b50b-9e62-4ff3-9875-3d4635597b45" status: 200 len: 1698 microversion: 2.1 time: 0.246516 Jul 18 10:31:25.169140 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 172/345] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:31:24 2022] GET /compute/v2.1/servers/dcb1b50b-9e62-4ff3-9875-3d4635597b45 => generated 1698 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:31:25.169269 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-5ea4bef3-1218-43ff-a56a-29631fd38104 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a431c9708f4694bc0d514133e76088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a1921237622439bab89676e11477c13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:31:25.174711 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-81907eba-4f97-445f-8ee6-f704b9dc4486 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:31:25.175248 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-81907eba-4f97-445f-8ee6-f704b9dc4486 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] [instance: 1e3ca3fe-e03a-47e3-9d9c-a6ab431e2dd7] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:31:25.177896 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-5ea4bef3-1218-43ff-a56a-29631fd38104 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] 10.222.0.33 "GET /compute/v2.1/servers/a3dbac58-662d-4720-8bcf-2300f9a9a5d1" status: 200 len: 1371 microversion: 2.1 time: 0.266774 Jul 18 10:31:25.186981 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 174/346] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:31:24 2022] GET /compute/v2.1/servers/a3dbac58-662d-4720-8bcf-2300f9a9a5d1 => generated 1371 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:31:25.186981 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-5f67cc43-0b72-4f18-b081-c89641054043 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:31:25.188064 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-81907eba-4f97-445f-8ee6-f704b9dc4486 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:31:25.188539 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-81907eba-4f97-445f-8ee6-f704b9dc4486 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:31:25.189836 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-81907eba-4f97-445f-8ee6-f704b9dc4486 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:31:25.190272 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-81907eba-4f97-445f-8ee6-f704b9dc4486 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:31:25.191595 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-5f67cc43-0b72-4f18-b081-c89641054043 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:31:25.192054 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-5f67cc43-0b72-4f18-b081-c89641054043 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:31:25.253465 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-5f67cc43-0b72-4f18-b081-c89641054043 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] [instance: dcb1b50b-9e62-4ff3-9875-3d4635597b45] Going to try to start instance {{(pid=117879) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 18 10:31:25.297880 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-5f67cc43-0b72-4f18-b081-c89641054043 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] 10.222.0.33 "POST /compute/v2.1/servers/dcb1b50b-9e62-4ff3-9875-3d4635597b45/action" status: 202 len: 0 microversion: 2.1 time: 0.116762 Jul 18 10:31:25.301361 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 175/347] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Jul 18 10:31:25 2022] POST /compute/v2.1/servers/dcb1b50b-9e62-4ff3-9875-3d4635597b45/action => generated 0 bytes in 118 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 10:31:25.315559 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-db131d2c-67fb-403b-b6e8-2d24bc606337 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:31:25.316736 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-db131d2c-67fb-403b-b6e8-2d24bc606337 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] [instance: dcb1b50b-9e62-4ff3-9875-3d4635597b45] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:31:25.325301 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-db131d2c-67fb-403b-b6e8-2d24bc606337 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:31:25.325764 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-db131d2c-67fb-403b-b6e8-2d24bc606337 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:31:25.326543 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-db131d2c-67fb-403b-b6e8-2d24bc606337 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:31:25.327125 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-db131d2c-67fb-403b-b6e8-2d24bc606337 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:31:25.368902 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-81907eba-4f97-445f-8ee6-f704b9dc4486 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f25c72896a2d4d619e5ad4b5a0a79aa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cf3d5bfe9a745f38372c42c9cfa1f63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:31:25.380382 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-81907eba-4f97-445f-8ee6-f704b9dc4486 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] 10.222.0.33 "GET /compute/v2.1/servers/1e3ca3fe-e03a-47e3-9d9c-a6ab431e2dd7" status: 200 len: 1367 microversion: 2.1 time: 0.209933 Jul 18 10:31:25.381008 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 173/348] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:31:25 2022] GET /compute/v2.1/servers/1e3ca3fe-e03a-47e3-9d9c-a6ab431e2dd7 => generated 1367 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:31:25.498939 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-db131d2c-67fb-403b-b6e8-2d24bc606337 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '986f90dfbad14324b3fffbd790d60a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e487deb7ff45bdbf2cc002d42d12a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:31:25.515285 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-db131d2c-67fb-403b-b6e8-2d24bc606337 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] 10.222.0.33 "GET /compute/v2.1/servers/dcb1b50b-9e62-4ff3-9875-3d4635597b45" status: 200 len: 1707 microversion: 2.1 time: 0.204752 Jul 18 10:31:25.516117 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 176/349] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:31:25 2022] GET /compute/v2.1/servers/dcb1b50b-9e62-4ff3-9875-3d4635597b45 => generated 1707 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:31:26.008593 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [req-7f290f16-80e7-445e-9d14-7266c70d2ecf req-18531767-254e-4403-a549-629e8c99983a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3dbac58-662d-4720-8bcf-2300f9a9a5d1", "name": "network-vif-plugged", "status": "completed", "tag": "280c18f2-df08-4a5c-a1cc-01a91c5d3cfb"}]} {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:31:26.018839 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [req-7f290f16-80e7-445e-9d14-7266c70d2ecf req-18531767-254e-4403-a549-629e8c99983a service nova] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:31:26.019282 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [req-7f290f16-80e7-445e-9d14-7266c70d2ecf req-18531767-254e-4403-a549-629e8c99983a service nova] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:31:26.032312 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.compute.server_external_events [req-7f290f16-80e7-445e-9d14-7266c70d2ecf req-18531767-254e-4403-a549-629e8c99983a service nova] Creating event network-vif-plugged:280c18f2-df08-4a5c-a1cc-01a91c5d3cfb for instance a3dbac58-662d-4720-8bcf-2300f9a9a5d1 on hv-cinder-83754 Jul 18 10:31:26.037574 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [req-7f290f16-80e7-445e-9d14-7266c70d2ecf req-18531767-254e-4403-a549-629e8c99983a service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032491 Jul 18 10:31:26.038146 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 174/350] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jul 18 10:31:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:31:26.196315 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-cf6d3e6f-f610-40f1-b489-9fcb6dc941f7 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:31:26.197105 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-cf6d3e6f-f610-40f1-b489-9fcb6dc941f7 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] [instance: a3dbac58-662d-4720-8bcf-2300f9a9a5d1] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:31:26.205234 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-cf6d3e6f-f610-40f1-b489-9fcb6dc941f7 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:31:26.205692 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-cf6d3e6f-f610-40f1-b489-9fcb6dc941f7 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:31:26.206474 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-cf6d3e6f-f610-40f1-b489-9fcb6dc941f7 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:31:26.207061 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-cf6d3e6f-f610-40f1-b489-9fcb6dc941f7 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:31:26.397969 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-f2878adb-7b29-4a63-b0b5-0e8e1c052124 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:31:26.398696 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-f2878adb-7b29-4a63-b0b5-0e8e1c052124 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] [instance: 1e3ca3fe-e03a-47e3-9d9c-a6ab431e2dd7] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:31:26.406619 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-f2878adb-7b29-4a63-b0b5-0e8e1c052124 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:31:26.406619 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-f2878adb-7b29-4a63-b0b5-0e8e1c052124 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:31:26.406619 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-f2878adb-7b29-4a63-b0b5-0e8e1c052124 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:31:26.406876 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-f2878adb-7b29-4a63-b0b5-0e8e1c052124 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:31:26.466271 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-cf6d3e6f-f610-40f1-b489-9fcb6dc941f7 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a431c9708f4694bc0d514133e76088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a1921237622439bab89676e11477c13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:31:26.474461 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-cf6d3e6f-f610-40f1-b489-9fcb6dc941f7 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] 10.222.0.33 "GET /compute/v2.1/servers/a3dbac58-662d-4720-8bcf-2300f9a9a5d1" status: 200 len: 1371 microversion: 2.1 time: 0.281915 Jul 18 10:31:26.475046 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 177/351] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:31:26 2022] GET /compute/v2.1/servers/a3dbac58-662d-4720-8bcf-2300f9a9a5d1 => generated 1371 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:31:26.536886 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-cb5a93b0-5fab-40e0-86c7-60846f9d4639 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:31:26.537505 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-cb5a93b0-5fab-40e0-86c7-60846f9d4639 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] [instance: dcb1b50b-9e62-4ff3-9875-3d4635597b45] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:31:26.544784 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-cb5a93b0-5fab-40e0-86c7-60846f9d4639 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:31:26.545236 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-cb5a93b0-5fab-40e0-86c7-60846f9d4639 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:31:26.546577 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-cb5a93b0-5fab-40e0-86c7-60846f9d4639 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:31:26.547021 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-cb5a93b0-5fab-40e0-86c7-60846f9d4639 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:31:26.930583 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-f2878adb-7b29-4a63-b0b5-0e8e1c052124 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f25c72896a2d4d619e5ad4b5a0a79aa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cf3d5bfe9a745f38372c42c9cfa1f63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:31:26.933790 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-cb5a93b0-5fab-40e0-86c7-60846f9d4639 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '986f90dfbad14324b3fffbd790d60a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e487deb7ff45bdbf2cc002d42d12a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:31:26.938953 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-f2878adb-7b29-4a63-b0b5-0e8e1c052124 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] 10.222.0.33 "GET /compute/v2.1/servers/1e3ca3fe-e03a-47e3-9d9c-a6ab431e2dd7" status: 200 len: 1367 microversion: 2.1 time: 0.545016 Jul 18 10:31:26.939522 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 175/352] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:31:26 2022] GET /compute/v2.1/servers/1e3ca3fe-e03a-47e3-9d9c-a6ab431e2dd7 => generated 1367 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:31:26.951352 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-cb5a93b0-5fab-40e0-86c7-60846f9d4639 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] 10.222.0.33 "GET /compute/v2.1/servers/dcb1b50b-9e62-4ff3-9875-3d4635597b45" status: 200 len: 1707 microversion: 2.1 time: 0.418670 Jul 18 10:31:26.952261 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 178/353] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:31:26 2022] GET /compute/v2.1/servers/dcb1b50b-9e62-4ff3-9875-3d4635597b45 => generated 1707 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:31:27.492867 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-4095a30b-560a-414b-baef-047c63ed671c tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:31:27.494272 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-4095a30b-560a-414b-baef-047c63ed671c tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] [instance: a3dbac58-662d-4720-8bcf-2300f9a9a5d1] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:31:27.502796 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-4095a30b-560a-414b-baef-047c63ed671c tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:31:27.503383 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-4095a30b-560a-414b-baef-047c63ed671c tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:31:27.504486 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-4095a30b-560a-414b-baef-047c63ed671c tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:31:27.504941 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-4095a30b-560a-414b-baef-047c63ed671c tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:31:27.717437 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-4095a30b-560a-414b-baef-047c63ed671c tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a431c9708f4694bc0d514133e76088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a1921237622439bab89676e11477c13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:31:27.757892 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-4095a30b-560a-414b-baef-047c63ed671c tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] 10.222.0.33 "GET /compute/v2.1/servers/a3dbac58-662d-4720-8bcf-2300f9a9a5d1" status: 200 len: 1371 microversion: 2.1 time: 0.269702 Jul 18 10:31:27.758653 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 176/354] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:31:27 2022] GET /compute/v2.1/servers/a3dbac58-662d-4720-8bcf-2300f9a9a5d1 => generated 1371 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:31:27.956132 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-7baab55a-6689-4975-95c4-3530f6838a9f tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:31:27.956957 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-7baab55a-6689-4975-95c4-3530f6838a9f tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] [instance: 1e3ca3fe-e03a-47e3-9d9c-a6ab431e2dd7] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:31:27.964027 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-7baab55a-6689-4975-95c4-3530f6838a9f tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:31:27.964774 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-7baab55a-6689-4975-95c4-3530f6838a9f tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:31:27.966487 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-7baab55a-6689-4975-95c4-3530f6838a9f tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:31:27.966487 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-7baab55a-6689-4975-95c4-3530f6838a9f tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:31:27.969299 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-d679a25c-a328-4d14-b79c-83c14feac101 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:31:27.970570 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-d679a25c-a328-4d14-b79c-83c14feac101 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] [instance: dcb1b50b-9e62-4ff3-9875-3d4635597b45] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:31:27.977928 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-d679a25c-a328-4d14-b79c-83c14feac101 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:31:27.979537 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-d679a25c-a328-4d14-b79c-83c14feac101 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:31:27.980593 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-d679a25c-a328-4d14-b79c-83c14feac101 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:31:27.981371 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-d679a25c-a328-4d14-b79c-83c14feac101 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:31:28.271444 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-7baab55a-6689-4975-95c4-3530f6838a9f tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f25c72896a2d4d619e5ad4b5a0a79aa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cf3d5bfe9a745f38372c42c9cfa1f63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:31:28.279996 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-7baab55a-6689-4975-95c4-3530f6838a9f tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] 10.222.0.33 "GET /compute/v2.1/servers/1e3ca3fe-e03a-47e3-9d9c-a6ab431e2dd7" status: 200 len: 1367 microversion: 2.1 time: 0.328105 Jul 18 10:31:28.280639 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 179/355] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:31:27 2022] GET /compute/v2.1/servers/1e3ca3fe-e03a-47e3-9d9c-a6ab431e2dd7 => generated 1367 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:31:28.297818 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-d679a25c-a328-4d14-b79c-83c14feac101 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '986f90dfbad14324b3fffbd790d60a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e487deb7ff45bdbf2cc002d42d12a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:31:28.306862 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-d679a25c-a328-4d14-b79c-83c14feac101 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] 10.222.0.33 "GET /compute/v2.1/servers/dcb1b50b-9e62-4ff3-9875-3d4635597b45" status: 200 len: 1707 microversion: 2.1 time: 0.341787 Jul 18 10:31:28.307431 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 177/356] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:31:27 2022] GET /compute/v2.1/servers/dcb1b50b-9e62-4ff3-9875-3d4635597b45 => generated 1707 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:31:28.775185 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-67e1a0e7-ed7c-4d8e-9725-035f10f863bf tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:31:28.775806 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-67e1a0e7-ed7c-4d8e-9725-035f10f863bf tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] [instance: a3dbac58-662d-4720-8bcf-2300f9a9a5d1] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:31:28.788588 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-67e1a0e7-ed7c-4d8e-9725-035f10f863bf tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:31:28.789068 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-67e1a0e7-ed7c-4d8e-9725-035f10f863bf tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:31:28.789913 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-67e1a0e7-ed7c-4d8e-9725-035f10f863bf tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:31:28.790359 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-67e1a0e7-ed7c-4d8e-9725-035f10f863bf tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:31:29.014433 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-67e1a0e7-ed7c-4d8e-9725-035f10f863bf tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a431c9708f4694bc0d514133e76088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a1921237622439bab89676e11477c13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:31:29.024405 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-67e1a0e7-ed7c-4d8e-9725-035f10f863bf tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] 10.222.0.33 "GET /compute/v2.1/servers/a3dbac58-662d-4720-8bcf-2300f9a9a5d1" status: 200 len: 1371 microversion: 2.1 time: 0.253120 Jul 18 10:31:29.025697 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 180/357] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:31:28 2022] GET /compute/v2.1/servers/a3dbac58-662d-4720-8bcf-2300f9a9a5d1 => generated 1371 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:31:29.299880 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-0be83b57-65fe-4fa7-bcf8-c58d261ffa7a tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:31:29.301197 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-0be83b57-65fe-4fa7-bcf8-c58d261ffa7a tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] [instance: 1e3ca3fe-e03a-47e3-9d9c-a6ab431e2dd7] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:31:29.309313 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-0be83b57-65fe-4fa7-bcf8-c58d261ffa7a tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:31:29.310129 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-0be83b57-65fe-4fa7-bcf8-c58d261ffa7a tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:31:29.311406 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-0be83b57-65fe-4fa7-bcf8-c58d261ffa7a tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:31:29.312005 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-0be83b57-65fe-4fa7-bcf8-c58d261ffa7a tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:31:29.323626 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-e963af44-b014-42ad-9431-25975e5d1ba5 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:31:29.324354 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-e963af44-b014-42ad-9431-25975e5d1ba5 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] [instance: dcb1b50b-9e62-4ff3-9875-3d4635597b45] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:31:29.338547 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-e963af44-b014-42ad-9431-25975e5d1ba5 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:31:29.339011 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-e963af44-b014-42ad-9431-25975e5d1ba5 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:31:29.340033 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-e963af44-b014-42ad-9431-25975e5d1ba5 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:31:29.340675 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-e963af44-b014-42ad-9431-25975e5d1ba5 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:31:29.555097 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-e963af44-b014-42ad-9431-25975e5d1ba5 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '986f90dfbad14324b3fffbd790d60a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e487deb7ff45bdbf2cc002d42d12a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:31:29.557090 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-0be83b57-65fe-4fa7-bcf8-c58d261ffa7a tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f25c72896a2d4d619e5ad4b5a0a79aa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cf3d5bfe9a745f38372c42c9cfa1f63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:31:29.563502 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-e963af44-b014-42ad-9431-25975e5d1ba5 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] 10.222.0.33 "GET /compute/v2.1/servers/dcb1b50b-9e62-4ff3-9875-3d4635597b45" status: 200 len: 1707 microversion: 2.1 time: 0.244069 Jul 18 10:31:29.564153 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 181/358] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:31:29 2022] GET /compute/v2.1/servers/dcb1b50b-9e62-4ff3-9875-3d4635597b45 => generated 1707 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:31:29.574808 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-0be83b57-65fe-4fa7-bcf8-c58d261ffa7a tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] 10.222.0.33 "GET /compute/v2.1/servers/1e3ca3fe-e03a-47e3-9d9c-a6ab431e2dd7" status: 200 len: 1557 microversion: 2.1 time: 0.280349 Jul 18 10:31:29.575502 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 178/359] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:31:29 2022] GET /compute/v2.1/servers/1e3ca3fe-e03a-47e3-9d9c-a6ab431e2dd7 => generated 1557 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:31:29.591138 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-559b9434-c19f-448b-9402-9120058a9cc1 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:31:29.591572 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-559b9434-c19f-448b-9402-9120058a9cc1 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] [instance: 1e3ca3fe-e03a-47e3-9d9c-a6ab431e2dd7] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:31:29.598202 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-559b9434-c19f-448b-9402-9120058a9cc1 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:31:29.598658 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-559b9434-c19f-448b-9402-9120058a9cc1 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:31:29.599608 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-559b9434-c19f-448b-9402-9120058a9cc1 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:31:29.600216 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-559b9434-c19f-448b-9402-9120058a9cc1 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:31:29.688152 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-559b9434-c19f-448b-9402-9120058a9cc1 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] 10.222.0.33 "GET /compute/v2.1/servers/1e3ca3fe-e03a-47e3-9d9c-a6ab431e2dd7/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.100834 Jul 18 10:31:29.688937 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 182/360] 10.222.0.33 () {58 vars in 1274 bytes} [Mon Jul 18 10:31:29 2022] GET /compute/v2.1/servers/1e3ca3fe-e03a-47e3-9d9c-a6ab431e2dd7/os-interface => generated 284 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:31:30.043552 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-da6ba5bd-498b-44a8-b9fe-6c5df3d120b2 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:31:30.044153 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-da6ba5bd-498b-44a8-b9fe-6c5df3d120b2 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] [instance: a3dbac58-662d-4720-8bcf-2300f9a9a5d1] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:31:30.055085 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-da6ba5bd-498b-44a8-b9fe-6c5df3d120b2 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:31:30.056041 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-da6ba5bd-498b-44a8-b9fe-6c5df3d120b2 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:31:30.056846 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-da6ba5bd-498b-44a8-b9fe-6c5df3d120b2 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:31:30.057276 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-da6ba5bd-498b-44a8-b9fe-6c5df3d120b2 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:31:30.289228 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-da6ba5bd-498b-44a8-b9fe-6c5df3d120b2 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a431c9708f4694bc0d514133e76088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a1921237622439bab89676e11477c13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:31:30.297466 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-da6ba5bd-498b-44a8-b9fe-6c5df3d120b2 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] 10.222.0.33 "GET /compute/v2.1/servers/a3dbac58-662d-4720-8bcf-2300f9a9a5d1" status: 200 len: 1371 microversion: 2.1 time: 0.258335 Jul 18 10:31:30.298388 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 179/361] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:31:30 2022] GET /compute/v2.1/servers/a3dbac58-662d-4720-8bcf-2300f9a9a5d1 => generated 1371 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:31:30.586049 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-f84fba5b-ef09-47a9-8b79-3fcc66a0b8b1 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:31:30.587639 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-f84fba5b-ef09-47a9-8b79-3fcc66a0b8b1 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] [instance: dcb1b50b-9e62-4ff3-9875-3d4635597b45] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:31:30.608378 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-f84fba5b-ef09-47a9-8b79-3fcc66a0b8b1 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:31:30.609489 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-f84fba5b-ef09-47a9-8b79-3fcc66a0b8b1 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:31:30.611237 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-f84fba5b-ef09-47a9-8b79-3fcc66a0b8b1 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:31:30.612193 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-f84fba5b-ef09-47a9-8b79-3fcc66a0b8b1 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:31:30.791493 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-f84fba5b-ef09-47a9-8b79-3fcc66a0b8b1 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '986f90dfbad14324b3fffbd790d60a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e487deb7ff45bdbf2cc002d42d12a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:31:30.801628 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-f84fba5b-ef09-47a9-8b79-3fcc66a0b8b1 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] 10.222.0.33 "GET /compute/v2.1/servers/dcb1b50b-9e62-4ff3-9875-3d4635597b45" status: 200 len: 1707 microversion: 2.1 time: 0.224404 Jul 18 10:31:30.802631 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 183/362] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:31:30 2022] GET /compute/v2.1/servers/dcb1b50b-9e62-4ff3-9875-3d4635597b45 => generated 1707 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:31:31.316072 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-4428aeb7-9560-4f3b-9a4e-e061b0d39f68 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:31:31.316827 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-4428aeb7-9560-4f3b-9a4e-e061b0d39f68 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] [instance: a3dbac58-662d-4720-8bcf-2300f9a9a5d1] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:31:31.323930 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-4428aeb7-9560-4f3b-9a4e-e061b0d39f68 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:31:31.325761 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-4428aeb7-9560-4f3b-9a4e-e061b0d39f68 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:31:31.325761 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-4428aeb7-9560-4f3b-9a4e-e061b0d39f68 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:31:31.326165 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-4428aeb7-9560-4f3b-9a4e-e061b0d39f68 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:31:31.502209 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-4428aeb7-9560-4f3b-9a4e-e061b0d39f68 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a431c9708f4694bc0d514133e76088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a1921237622439bab89676e11477c13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:31:31.518412 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-4428aeb7-9560-4f3b-9a4e-e061b0d39f68 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] 10.222.0.33 "GET /compute/v2.1/servers/a3dbac58-662d-4720-8bcf-2300f9a9a5d1" status: 200 len: 1564 microversion: 2.1 time: 0.204915 Jul 18 10:31:31.519273 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 180/363] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:31:31 2022] GET /compute/v2.1/servers/a3dbac58-662d-4720-8bcf-2300f9a9a5d1 => generated 1564 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:31:31.537446 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-c823b76b-98ee-40c0-9cec-16563f8b3031 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:31:31.537954 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-c823b76b-98ee-40c0-9cec-16563f8b3031 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] [instance: a3dbac58-662d-4720-8bcf-2300f9a9a5d1] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:31:31.544928 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-c823b76b-98ee-40c0-9cec-16563f8b3031 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:31:31.545641 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-c823b76b-98ee-40c0-9cec-16563f8b3031 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:31:31.546676 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-c823b76b-98ee-40c0-9cec-16563f8b3031 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:31:31.547328 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-c823b76b-98ee-40c0-9cec-16563f8b3031 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:31:31.610457 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [req-fed999b3-1a0e-407c-b7b6-2aae216df541 req-26ce511a-908a-49dd-8a7e-0e9f1eff2b1f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1e3ca3fe-e03a-47e3-9d9c-a6ab431e2dd7", "tag": "45d07fc3-9cad-4182-885d-f3a4c1ec9917"}]} {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:31:31.629341 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [req-fed999b3-1a0e-407c-b7b6-2aae216df541 req-26ce511a-908a-49dd-8a7e-0e9f1eff2b1f service nova] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:31:31.630342 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [req-fed999b3-1a0e-407c-b7b6-2aae216df541 req-26ce511a-908a-49dd-8a7e-0e9f1eff2b1f service nova] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:31:31.644909 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-c823b76b-98ee-40c0-9cec-16563f8b3031 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] 10.222.0.33 "GET /compute/v2.1/servers/a3dbac58-662d-4720-8bcf-2300f9a9a5d1/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.112326 Jul 18 10:31:31.646225 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 184/364] 10.222.0.33 () {58 vars in 1274 bytes} [Mon Jul 18 10:31:31 2022] GET /compute/v2.1/servers/a3dbac58-662d-4720-8bcf-2300f9a9a5d1/os-interface => generated 284 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:31:31.663518 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.compute.server_external_events [req-fed999b3-1a0e-407c-b7b6-2aae216df541 req-26ce511a-908a-49dd-8a7e-0e9f1eff2b1f service nova] Creating event network-changed:45d07fc3-9cad-4182-885d-f3a4c1ec9917 for instance 1e3ca3fe-e03a-47e3-9d9c-a6ab431e2dd7 on hv-cinder-83754 Jul 18 10:31:31.669613 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [req-fed999b3-1a0e-407c-b7b6-2aae216df541 req-26ce511a-908a-49dd-8a7e-0e9f1eff2b1f service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062726 Jul 18 10:31:31.670833 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 181/365] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jul 18 10:31:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:31:31.821164 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-71cf6082-1af8-4c96-9cc4-f22ac148b924 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:31:31.821788 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-71cf6082-1af8-4c96-9cc4-f22ac148b924 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] [instance: dcb1b50b-9e62-4ff3-9875-3d4635597b45] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:31:31.858107 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-71cf6082-1af8-4c96-9cc4-f22ac148b924 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:31:31.862094 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-71cf6082-1af8-4c96-9cc4-f22ac148b924 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:31:31.864492 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-71cf6082-1af8-4c96-9cc4-f22ac148b924 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:31:31.866864 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-71cf6082-1af8-4c96-9cc4-f22ac148b924 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:31:32.196139 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-7367ac1a-d16b-4db3-b625-23ccac7a56de tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:31:32.196849 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-7367ac1a-d16b-4db3-b625-23ccac7a56de tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] [instance: 233328a3-8e4b-4ece-8072-1a31d00d730f] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:31:32.210600 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-7367ac1a-d16b-4db3-b625-23ccac7a56de tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:31:32.211156 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-7367ac1a-d16b-4db3-b625-23ccac7a56de tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:31:32.213982 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-7367ac1a-d16b-4db3-b625-23ccac7a56de tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:31:32.214548 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-7367ac1a-d16b-4db3-b625-23ccac7a56de tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:31:32.379594 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.objects.instance [None req-7367ac1a-d16b-4db3-b625-23ccac7a56de tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Lazy-loading 'services' on Instance uuid 233328a3-8e4b-4ece-8072-1a31d00d730f {{(pid=117880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 10:31:32.496222 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-71cf6082-1af8-4c96-9cc4-f22ac148b924 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '986f90dfbad14324b3fffbd790d60a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e487deb7ff45bdbf2cc002d42d12a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:31:32.502311 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG dbcounter [-] [117879] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:31:32.510255 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-71cf6082-1af8-4c96-9cc4-f22ac148b924 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] 10.222.0.33 "GET /compute/v2.1/servers/dcb1b50b-9e62-4ff3-9875-3d4635597b45" status: 200 len: 1707 microversion: 2.1 time: 0.693633 Jul 18 10:31:32.516712 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 185/366] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:31:31 2022] GET /compute/v2.1/servers/dcb1b50b-9e62-4ff3-9875-3d4635597b45 => generated 1707 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:31:32.590189 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-7367ac1a-d16b-4db3-b625-23ccac7a56de tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] 10.222.0.33 "DELETE /compute/v2.1/servers/233328a3-8e4b-4ece-8072-1a31d00d730f/os-volume_attachments/78c1430f-3781-4dff-ab55-f00da164f906" status: 202 len: 0 microversion: 2.1 time: 0.396037 Jul 18 10:31:32.591084 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 182/367] 10.222.0.33 () {58 vars in 1415 bytes} [Mon Jul 18 10:31:32 2022] DELETE /compute/v2.1/servers/233328a3-8e4b-4ece-8072-1a31d00d730f/os-volume_attachments/78c1430f-3781-4dff-ab55-f00da164f906 => generated 0 bytes in 401 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 18 10:31:33.527662 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-c842f2c4-00e6-463d-bd1e-9970d2bf24b2 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:31:33.528432 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-c842f2c4-00e6-463d-bd1e-9970d2bf24b2 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] [instance: dcb1b50b-9e62-4ff3-9875-3d4635597b45] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:31:33.539640 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-c842f2c4-00e6-463d-bd1e-9970d2bf24b2 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:31:33.541117 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-c842f2c4-00e6-463d-bd1e-9970d2bf24b2 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:31:33.542315 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-c842f2c4-00e6-463d-bd1e-9970d2bf24b2 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:31:33.543302 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-c842f2c4-00e6-463d-bd1e-9970d2bf24b2 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:31:33.885682 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-20b4e23d-f5bd-414f-9c72-f55179caeae9 tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:31:33.886292 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-20b4e23d-f5bd-414f-9c72-f55179caeae9 tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] [instance: 233328a3-8e4b-4ece-8072-1a31d00d730f] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:31:33.897967 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG dbcounter [-] [117880] Writing DB stats nova_api:SELECT=78 {{(pid=117880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:31:33.901521 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-20b4e23d-f5bd-414f-9c72-f55179caeae9 tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:31:33.903682 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-20b4e23d-f5bd-414f-9c72-f55179caeae9 tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:31:33.904488 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-20b4e23d-f5bd-414f-9c72-f55179caeae9 tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:31:33.909680 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-20b4e23d-f5bd-414f-9c72-f55179caeae9 tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:31:33.978978 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-20b4e23d-f5bd-414f-9c72-f55179caeae9 tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] [instance: 233328a3-8e4b-4ece-8072-1a31d00d730f] Going to try to terminate instance {{(pid=117880) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 10:31:34.144451 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-20b4e23d-f5bd-414f-9c72-f55179caeae9 tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] 10.222.0.33 "DELETE /compute/v2.1/servers/233328a3-8e4b-4ece-8072-1a31d00d730f" status: 204 len: 0 microversion: 2.1 time: 0.264518 Jul 18 10:31:34.145511 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 183/368] 10.222.0.33 () {58 vars in 1238 bytes} [Mon Jul 18 10:31:33 2022] DELETE /compute/v2.1/servers/233328a3-8e4b-4ece-8072-1a31d00d730f => generated 0 bytes in 267 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 10:31:34.155476 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-c9097f6d-41d0-411c-88b9-bf66d0ac1bd5 tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:31:34.156570 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-c9097f6d-41d0-411c-88b9-bf66d0ac1bd5 tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] [instance: 233328a3-8e4b-4ece-8072-1a31d00d730f] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:31:34.158146 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-c842f2c4-00e6-463d-bd1e-9970d2bf24b2 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '986f90dfbad14324b3fffbd790d60a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e487deb7ff45bdbf2cc002d42d12a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:31:34.169657 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-c842f2c4-00e6-463d-bd1e-9970d2bf24b2 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] 10.222.0.33 "GET /compute/v2.1/servers/dcb1b50b-9e62-4ff3-9875-3d4635597b45" status: 200 len: 1711 microversion: 2.1 time: 0.646004 Jul 18 10:31:34.172036 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 186/369] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:31:33 2022] GET /compute/v2.1/servers/dcb1b50b-9e62-4ff3-9875-3d4635597b45 => generated 1711 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:31:34.183276 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-c9097f6d-41d0-411c-88b9-bf66d0ac1bd5 tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:31:34.183979 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-c9097f6d-41d0-411c-88b9-bf66d0ac1bd5 tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:31:34.185185 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-c9097f6d-41d0-411c-88b9-bf66d0ac1bd5 tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:31:34.185698 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-c9097f6d-41d0-411c-88b9-bf66d0ac1bd5 tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:31:34.465586 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-c9097f6d-41d0-411c-88b9-bf66d0ac1bd5 tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c9439cb644548b8b3b5fd5c610757b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6203312784435b8cd1fdfede3fb597', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:31:34.480161 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-c9097f6d-41d0-411c-88b9-bf66d0ac1bd5 tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] 10.222.0.33 "GET /compute/v2.1/servers/233328a3-8e4b-4ece-8072-1a31d00d730f" status: 200 len: 1513 microversion: 2.1 time: 0.329261 Jul 18 10:31:34.481659 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 184/370] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:31:34 2022] GET /compute/v2.1/servers/233328a3-8e4b-4ece-8072-1a31d00d730f => generated 1513 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:31:34.758393 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [req-1a66a856-87e9-4653-ad98-560c6fe21d0a req-e0729b85-17d5-4a8c-b7fe-bc21927af51e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a3dbac58-662d-4720-8bcf-2300f9a9a5d1", "tag": "280c18f2-df08-4a5c-a1cc-01a91c5d3cfb"}]} {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:31:34.776376 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [req-1a66a856-87e9-4653-ad98-560c6fe21d0a req-e0729b85-17d5-4a8c-b7fe-bc21927af51e service nova] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:31:34.777081 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [req-1a66a856-87e9-4653-ad98-560c6fe21d0a req-e0729b85-17d5-4a8c-b7fe-bc21927af51e service nova] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:31:34.808753 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.compute.server_external_events [req-1a66a856-87e9-4653-ad98-560c6fe21d0a req-e0729b85-17d5-4a8c-b7fe-bc21927af51e service nova] Creating event network-changed:280c18f2-df08-4a5c-a1cc-01a91c5d3cfb for instance a3dbac58-662d-4720-8bcf-2300f9a9a5d1 on hv-cinder-83754 Jul 18 10:31:34.822372 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [req-1a66a856-87e9-4653-ad98-560c6fe21d0a req-e0729b85-17d5-4a8c-b7fe-bc21927af51e service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065290 Jul 18 10:31:34.823954 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 187/371] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jul 18 10:31:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:31:35.514923 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-0596d67e-39c2-4345-ad43-c5dc3414b4dd tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:31:35.516071 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-0596d67e-39c2-4345-ad43-c5dc3414b4dd tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] [instance: 233328a3-8e4b-4ece-8072-1a31d00d730f] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:31:35.525152 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-0596d67e-39c2-4345-ad43-c5dc3414b4dd tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:31:35.525601 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-0596d67e-39c2-4345-ad43-c5dc3414b4dd tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:31:35.526388 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-0596d67e-39c2-4345-ad43-c5dc3414b4dd tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:31:35.526825 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-0596d67e-39c2-4345-ad43-c5dc3414b4dd tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:31:35.706957 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-0596d67e-39c2-4345-ad43-c5dc3414b4dd tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c9439cb644548b8b3b5fd5c610757b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6203312784435b8cd1fdfede3fb597', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:31:35.717995 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-0596d67e-39c2-4345-ad43-c5dc3414b4dd tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] 10.222.0.33 "GET /compute/v2.1/servers/233328a3-8e4b-4ece-8072-1a31d00d730f" status: 200 len: 1513 microversion: 2.1 time: 0.217168 Jul 18 10:31:35.719385 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 185/372] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:31:35 2022] GET /compute/v2.1/servers/233328a3-8e4b-4ece-8072-1a31d00d730f => generated 1513 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:31:35.936211 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-3d29ed7a-e361-4e61-a120-9dfcbe1a2e1c tempest-VolumesNegativeTest-1214922722 tempest-VolumesNegativeTest-1214922722-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1116250113", "imageRef": "2cb02169-9999-411b-8c74-f88c068960fc", "flavorRef": "452"}} {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:31:36.002247 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.network.neutron [None req-3d29ed7a-e361-4e61-a120-9dfcbe1a2e1c tempest-VolumesNegativeTest-1214922722 tempest-VolumesNegativeTest-1214922722-project] validate_networks() for None {{(pid=117879) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 10:31:36.737337 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-5657acff-6ca5-4f20-b163-fed84d125c3d tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:31:36.737962 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-5657acff-6ca5-4f20-b163-fed84d125c3d tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] [instance: 233328a3-8e4b-4ece-8072-1a31d00d730f] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:31:36.745561 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-5657acff-6ca5-4f20-b163-fed84d125c3d tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:31:36.767893 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-5657acff-6ca5-4f20-b163-fed84d125c3d tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:31:36.770269 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-5657acff-6ca5-4f20-b163-fed84d125c3d tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:31:36.770940 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-5657acff-6ca5-4f20-b163-fed84d125c3d tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:31:36.945307 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.virt.hardware [None req-3d29ed7a-e361-4e61-a120-9dfcbe1a2e1c tempest-VolumesNegativeTest-1214922722 tempest-VolumesNegativeTest-1214922722-project] Flavor limits 0:0:0 {{(pid=117879) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 10:31:36.945897 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.virt.hardware [None req-3d29ed7a-e361-4e61-a120-9dfcbe1a2e1c tempest-VolumesNegativeTest-1214922722 tempest-VolumesNegativeTest-1214922722-project] Image limits 0:0:0 {{(pid=117879) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 10:31:36.946202 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.virt.hardware [None req-3d29ed7a-e361-4e61-a120-9dfcbe1a2e1c tempest-VolumesNegativeTest-1214922722 tempest-VolumesNegativeTest-1214922722-project] Flavor pref 0:0:0 {{(pid=117879) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 10:31:36.946625 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.virt.hardware [None req-3d29ed7a-e361-4e61-a120-9dfcbe1a2e1c tempest-VolumesNegativeTest-1214922722 tempest-VolumesNegativeTest-1214922722-project] Image pref 0:0:0 {{(pid=117879) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 10:31:36.947073 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.virt.hardware [None req-3d29ed7a-e361-4e61-a120-9dfcbe1a2e1c tempest-VolumesNegativeTest-1214922722 tempest-VolumesNegativeTest-1214922722-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117879) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 10:31:36.959073 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-3d29ed7a-e361-4e61-a120-9dfcbe1a2e1c tempest-VolumesNegativeTest-1214922722 tempest-VolumesNegativeTest-1214922722-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:31:36.959972 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-3d29ed7a-e361-4e61-a120-9dfcbe1a2e1c tempest-VolumesNegativeTest-1214922722 tempest-VolumesNegativeTest-1214922722-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:31:36.961009 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-3d29ed7a-e361-4e61-a120-9dfcbe1a2e1c tempest-VolumesNegativeTest-1214922722 tempest-VolumesNegativeTest-1214922722-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:31:36.961648 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-3d29ed7a-e361-4e61-a120-9dfcbe1a2e1c tempest-VolumesNegativeTest-1214922722 tempest-VolumesNegativeTest-1214922722-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:31:36.999804 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.quota [None req-3d29ed7a-e361-4e61-a120-9dfcbe1a2e1c tempest-VolumesNegativeTest-1214922722 tempest-VolumesNegativeTest-1214922722-project] Getting quotas for project 0bd9fedf211d41878c431ee91f87aaf8. Resources: {'ram', 'cores', 'instances'} {{(pid=117879) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 10:31:37.006264 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.quota [None req-3d29ed7a-e361-4e61-a120-9dfcbe1a2e1c tempest-VolumesNegativeTest-1214922722 tempest-VolumesNegativeTest-1214922722-project] Getting quotas for user 37a5ceff981447c4a65c0f2cec7607a0 and project 0bd9fedf211d41878c431ee91f87aaf8. Resources: {'ram', 'cores', 'instances'} {{(pid=117879) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 10:31:37.022399 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-3d29ed7a-e361-4e61-a120-9dfcbe1a2e1c tempest-VolumesNegativeTest-1214922722 tempest-VolumesNegativeTest-1214922722-project] Going to run 1 instances... {{(pid=117879) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 10:31:37.027888 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-3d29ed7a-e361-4e61-a120-9dfcbe1a2e1c tempest-VolumesNegativeTest-1214922722 tempest-VolumesNegativeTest-1214922722-project] [instance: afd07f97-a630-410b-88c8-ce71e4f9eb32] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2cb02169-9999-411b-8c74-f88c068960fc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117879) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 10:31:37.134051 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-3d29ed7a-e361-4e61-a120-9dfcbe1a2e1c tempest-VolumesNegativeTest-1214922722 tempest-VolumesNegativeTest-1214922722-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.197464 Jul 18 10:31:37.135040 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 188/373] 10.222.0.33 () {60 vars in 1146 bytes} [Mon Jul 18 10:31:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 1204 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 10:31:37.148106 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-c10a6121-05b4-4cb0-b03a-f41e82fb25d6 tempest-VolumesNegativeTest-1214922722 tempest-VolumesNegativeTest-1214922722-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:31:37.148764 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-c10a6121-05b4-4cb0-b03a-f41e82fb25d6 tempest-VolumesNegativeTest-1214922722 tempest-VolumesNegativeTest-1214922722-project] [instance: afd07f97-a630-410b-88c8-ce71e4f9eb32] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:31:37.346518 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-c10a6121-05b4-4cb0-b03a-f41e82fb25d6 tempest-VolumesNegativeTest-1214922722 tempest-VolumesNegativeTest-1214922722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a5ceff981447c4a65c0f2cec7607a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd9fedf211d41878c431ee91f87aaf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:31:37.355198 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-c10a6121-05b4-4cb0-b03a-f41e82fb25d6 tempest-VolumesNegativeTest-1214922722 tempest-VolumesNegativeTest-1214922722-project] 10.222.0.33 "GET /compute/v2.1/servers/afd07f97-a630-410b-88c8-ce71e4f9eb32" status: 200 len: 1215 microversion: 2.1 time: 0.214046 Jul 18 10:31:37.365647 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 189/374] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:31:37 2022] GET /compute/v2.1/servers/afd07f97-a630-410b-88c8-ce71e4f9eb32 => generated 1215 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:31:37.462495 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-5657acff-6ca5-4f20-b163-fed84d125c3d tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c9439cb644548b8b3b5fd5c610757b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6203312784435b8cd1fdfede3fb597', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:31:37.472176 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-5657acff-6ca5-4f20-b163-fed84d125c3d tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] 10.222.0.33 "GET /compute/v2.1/servers/233328a3-8e4b-4ece-8072-1a31d00d730f" status: 200 len: 1513 microversion: 2.1 time: 0.740713 Jul 18 10:31:37.487590 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 186/375] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:31:36 2022] GET /compute/v2.1/servers/233328a3-8e4b-4ece-8072-1a31d00d730f => generated 1513 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:31:38.064645 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [req-59e8db99-373b-4e93-a3b0-8c45c12c71c1 req-1a85385d-8b4e-453a-ba36-ce4125cd3db5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "233328a3-8e4b-4ece-8072-1a31d00d730f", "name": "network-vif-deleted", "tag": "c7e3d10c-31e5-479a-8314-39f962197adb"}]} {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:31:38.087553 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [req-59e8db99-373b-4e93-a3b0-8c45c12c71c1 req-1a85385d-8b4e-453a-ba36-ce4125cd3db5 service nova] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:31:38.088332 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [req-59e8db99-373b-4e93-a3b0-8c45c12c71c1 req-1a85385d-8b4e-453a-ba36-ce4125cd3db5 service nova] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:31:38.102653 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.compute.server_external_events [req-59e8db99-373b-4e93-a3b0-8c45c12c71c1 req-1a85385d-8b4e-453a-ba36-ce4125cd3db5 service nova] Creating event network-vif-deleted:c7e3d10c-31e5-479a-8314-39f962197adb for instance 233328a3-8e4b-4ece-8072-1a31d00d730f on hv-cinder-83754 Jul 18 10:31:38.111593 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [req-59e8db99-373b-4e93-a3b0-8c45c12c71c1 req-1a85385d-8b4e-453a-ba36-ce4125cd3db5 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059879 Jul 18 10:31:38.112589 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 190/376] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jul 18 10:31:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:31:38.381933 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-6a446c68-e9e9-4e65-bdc5-6a24d6f76f83 tempest-VolumesNegativeTest-1214922722 tempest-VolumesNegativeTest-1214922722-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:31:38.382572 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-6a446c68-e9e9-4e65-bdc5-6a24d6f76f83 tempest-VolumesNegativeTest-1214922722 tempest-VolumesNegativeTest-1214922722-project] [instance: afd07f97-a630-410b-88c8-ce71e4f9eb32] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:31:38.389557 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-6a446c68-e9e9-4e65-bdc5-6a24d6f76f83 tempest-VolumesNegativeTest-1214922722 tempest-VolumesNegativeTest-1214922722-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:31:38.389993 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-6a446c68-e9e9-4e65-bdc5-6a24d6f76f83 tempest-VolumesNegativeTest-1214922722 tempest-VolumesNegativeTest-1214922722-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:31:38.390755 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-6a446c68-e9e9-4e65-bdc5-6a24d6f76f83 tempest-VolumesNegativeTest-1214922722 tempest-VolumesNegativeTest-1214922722-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:31:38.391182 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-6a446c68-e9e9-4e65-bdc5-6a24d6f76f83 tempest-VolumesNegativeTest-1214922722 tempest-VolumesNegativeTest-1214922722-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:31:38.458470 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-6a446c68-e9e9-4e65-bdc5-6a24d6f76f83 tempest-VolumesNegativeTest-1214922722 tempest-VolumesNegativeTest-1214922722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a5ceff981447c4a65c0f2cec7607a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd9fedf211d41878c431ee91f87aaf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:31:38.467686 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG dbcounter [-] [117880] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:31:38.474774 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-6a446c68-e9e9-4e65-bdc5-6a24d6f76f83 tempest-VolumesNegativeTest-1214922722 tempest-VolumesNegativeTest-1214922722-project] 10.222.0.33 "GET /compute/v2.1/servers/afd07f97-a630-410b-88c8-ce71e4f9eb32" status: 200 len: 1267 microversion: 2.1 time: 0.096451 Jul 18 10:31:38.475475 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 187/377] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:31:38 2022] GET /compute/v2.1/servers/afd07f97-a630-410b-88c8-ce71e4f9eb32 => generated 1267 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:31:38.504456 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-d6c44da0-3899-404e-951a-3f7526fd1f12 tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:31:38.505285 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-d6c44da0-3899-404e-951a-3f7526fd1f12 tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] [instance: 233328a3-8e4b-4ece-8072-1a31d00d730f] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:31:38.512524 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-d6c44da0-3899-404e-951a-3f7526fd1f12 tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:31:38.513049 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-d6c44da0-3899-404e-951a-3f7526fd1f12 tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:31:38.513847 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-d6c44da0-3899-404e-951a-3f7526fd1f12 tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:31:38.514290 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-d6c44da0-3899-404e-951a-3f7526fd1f12 tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:31:38.548904 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-d6c44da0-3899-404e-951a-3f7526fd1f12 tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:31:38.549521 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-d6c44da0-3899-404e-951a-3f7526fd1f12 tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:31:38.549981 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.objects.instance [None req-d6c44da0-3899-404e-951a-3f7526fd1f12 tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Lazy-loading 'fault' on Instance uuid 233328a3-8e4b-4ece-8072-1a31d00d730f {{(pid=117879) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 10:31:38.598182 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-d6c44da0-3899-404e-951a-3f7526fd1f12 tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c9439cb644548b8b3b5fd5c610757b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6203312784435b8cd1fdfede3fb597', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:31:38.610186 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-d6c44da0-3899-404e-951a-3f7526fd1f12 tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] 10.222.0.33 "GET /compute/v2.1/servers/233328a3-8e4b-4ece-8072-1a31d00d730f" status: 200 len: 1308 microversion: 2.1 time: 0.110116 Jul 18 10:31:38.620739 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 191/378] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:31:38 2022] GET /compute/v2.1/servers/233328a3-8e4b-4ece-8072-1a31d00d730f => generated 1308 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:31:39.492663 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-6da0b8ee-c833-4a24-acdb-a394d5324e06 tempest-VolumesNegativeTest-1214922722 tempest-VolumesNegativeTest-1214922722-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:31:39.493289 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-6da0b8ee-c833-4a24-acdb-a394d5324e06 tempest-VolumesNegativeTest-1214922722 tempest-VolumesNegativeTest-1214922722-project] [instance: afd07f97-a630-410b-88c8-ce71e4f9eb32] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:31:39.506018 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-6da0b8ee-c833-4a24-acdb-a394d5324e06 tempest-VolumesNegativeTest-1214922722 tempest-VolumesNegativeTest-1214922722-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:31:39.506471 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-6da0b8ee-c833-4a24-acdb-a394d5324e06 tempest-VolumesNegativeTest-1214922722 tempest-VolumesNegativeTest-1214922722-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:31:39.507506 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-6da0b8ee-c833-4a24-acdb-a394d5324e06 tempest-VolumesNegativeTest-1214922722 tempest-VolumesNegativeTest-1214922722-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:31:39.507694 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-6da0b8ee-c833-4a24-acdb-a394d5324e06 tempest-VolumesNegativeTest-1214922722 tempest-VolumesNegativeTest-1214922722-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:31:39.627986 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-d09a4b96-297c-4a88-a192-91fde1ee5b65 tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:31:39.628638 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-d09a4b96-297c-4a88-a192-91fde1ee5b65 tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] [instance: 233328a3-8e4b-4ece-8072-1a31d00d730f] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:31:39.635697 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-d09a4b96-297c-4a88-a192-91fde1ee5b65 tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:31:39.636572 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-d09a4b96-297c-4a88-a192-91fde1ee5b65 tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:31:39.637632 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-d09a4b96-297c-4a88-a192-91fde1ee5b65 tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:31:39.638297 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-d09a4b96-297c-4a88-a192-91fde1ee5b65 tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:31:39.653166 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-6da0b8ee-c833-4a24-acdb-a394d5324e06 tempest-VolumesNegativeTest-1214922722 tempest-VolumesNegativeTest-1214922722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a5ceff981447c4a65c0f2cec7607a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd9fedf211d41878c431ee91f87aaf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:31:39.655630 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.wsgi [None req-d09a4b96-297c-4a88-a192-91fde1ee5b65 tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] HTTP exception thrown: Instance 233328a3-8e4b-4ece-8072-1a31d00d730f could not be found. Jul 18 10:31:39.658386 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-d09a4b96-297c-4a88-a192-91fde1ee5b65 tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Request method failure captured: Jul 18 10:31:39.658386 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: request: GET /compute/v2.1/servers/233328a3-8e4b-4ece-8072-1a31d00d730f HTTP/1.1 Jul 18 10:31:39.658386 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: Accept: application/json Jul 18 10:31:39.658386 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: Accept-Encoding: identity Jul 18 10:31:39.658386 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: Connection: close Jul 18 10:31:39.658386 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: Content-Length: 0 Jul 18 10:31:39.658386 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: Content-Type: application/json Jul 18 10:31:39.658386 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: Host: 10.222.0.33 Jul 18 10:31:39.658386 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: Openstack-System-Scope: None Jul 18 10:31:39.658386 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: User-Agent: python-urllib3/1.26.9 Jul 18 10:31:39.658386 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Auth-Token: gAAAAABi1TYsCCEd-uIhVXXHv9JaLkdkcB6EWKagewswES8W0Ml64Q0b4IBRrDzQ2yPfH_l_UFC6kYpaRMceDoDvm5OuNp5dTgL-y1qEOMLeCGwKtr-5CGnPTKkXL5BJ94M3uhRw33QP-I-OB3sPHTUkFXTvGX5aLMM_mrOirynsG56cBS4g1NE Jul 18 10:31:39.658386 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Domain-Id: None Jul 18 10:31:39.658386 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Domain-Name: None Jul 18 10:31:39.658386 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Identity-Status: Confirmed Jul 18 10:31:39.658386 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Is-Admin-Project: True Jul 18 10:31:39.658386 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Project-Domain-Id: default Jul 18 10:31:39.658386 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Project-Domain-Name: Default Jul 18 10:31:39.658386 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Project-Id: ee6203312784435b8cd1fdfede3fb597 Jul 18 10:31:39.658386 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Project-Name: tempest-VolumesSnapshotTestJSON-818269935 Jul 18 10:31:39.658386 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Role: member,reader Jul 18 10:31:39.658386 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Roles: member,reader Jul 18 10:31:39.659693 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ee6203312784435b8cd1fdfede3fb597"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ee6203312784435b8cd1fdfede3fb597"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/ee6203312784435b8cd1fdfede3fb597"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_ee6203312784435b8cd1fdfede3fb597"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jul 18 10:31:39.659693 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Tenant: tempest-VolumesSnapshotTestJSON-818269935 Jul 18 10:31:39.659693 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Tenant-Id: ee6203312784435b8cd1fdfede3fb597 Jul 18 10:31:39.659693 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-818269935 Jul 18 10:31:39.659693 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-User: tempest-VolumesSnapshotTestJSON-818269935-project Jul 18 10:31:39.659693 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-User-Domain-Id: default Jul 18 10:31:39.659693 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-User-Domain-Name: Default Jul 18 10:31:39.659693 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-User-Id: 8c9439cb644548b8b3b5fd5c610757b9 Jul 18 10:31:39.659693 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-User-Name: tempest-VolumesSnapshotTestJSON-818269935-project Jul 18 10:31:39.659693 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: method: > Jul 18 10:31:39.659693 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: exception: Instance 233328a3-8e4b-4ece-8072-1a31d00d730f could not be found. Jul 18 10:31:39.659693 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: action_args: {'id': '233328a3-8e4b-4ece-8072-1a31d00d730f'} Jul 18 10:31:39.661049 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 10:31:39.661049 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:31:39.661049 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 10:31:39.661049 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 10:31:39.661049 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 10:31:39.661049 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 10:31:39.661049 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 10:31:39.661049 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 10:31:39.661049 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 10:31:39.661049 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 10:31:39.661049 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 233328a3-8e4b-4ece-8072-1a31d00d730f could not be found. Jul 18 10:31:39.661049 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi Jul 18 10:31:39.661049 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:31:39.661049 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi Jul 18 10:31:39.661049 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:31:39.661049 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:31:39.661049 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:31:39.661049 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 10:31:39.661049 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 10:31:39.661049 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 10:31:39.662785 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 10:31:39.662785 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 10:31:39.662785 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 10:31:39.662785 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 10:31:39.662785 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 10:31:39.662785 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 10:31:39.662785 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 10:31:39.662785 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 233328a3-8e4b-4ece-8072-1a31d00d730f could not be found. Jul 18 10:31:39.662785 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi Jul 18 10:31:39.662785 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:31:39.662785 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi Jul 18 10:31:39.662785 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:31:39.662785 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:31:39.662785 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:31:39.662785 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 10:31:39.662785 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 10:31:39.662785 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 233328a3-8e4b-4ece-8072-1a31d00d730f could not be found. Jul 18 10:31:39.662785 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi Jul 18 10:31:39.663853 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-d09a4b96-297c-4a88-a192-91fde1ee5b65 tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Returning 404 to user: Instance 233328a3-8e4b-4ece-8072-1a31d00d730f could not be found. {{(pid=117879) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 10:31:39.663853 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-d09a4b96-297c-4a88-a192-91fde1ee5b65 tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] 10.222.0.33 "GET /compute/v2.1/servers/233328a3-8e4b-4ece-8072-1a31d00d730f" status: 404 len: 111 microversion: 2.1 time: 0.036419 Jul 18 10:31:39.664375 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 192/379] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:31:39 2022] GET /compute/v2.1/servers/233328a3-8e4b-4ece-8072-1a31d00d730f => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 18 10:31:39.672551 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-6da0b8ee-c833-4a24-acdb-a394d5324e06 tempest-VolumesNegativeTest-1214922722 tempest-VolumesNegativeTest-1214922722-project] 10.222.0.33 "GET /compute/v2.1/servers/afd07f97-a630-410b-88c8-ce71e4f9eb32" status: 200 len: 1273 microversion: 2.1 time: 0.174588 Jul 18 10:31:39.672551 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 188/380] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:31:39 2022] GET /compute/v2.1/servers/afd07f97-a630-410b-88c8-ce71e4f9eb32 => generated 1273 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:31:40.690405 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-64e8b823-4952-4f60-86e6-85ae9101e3e8 tempest-VolumesNegativeTest-1214922722 tempest-VolumesNegativeTest-1214922722-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:31:40.691803 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-64e8b823-4952-4f60-86e6-85ae9101e3e8 tempest-VolumesNegativeTest-1214922722 tempest-VolumesNegativeTest-1214922722-project] [instance: afd07f97-a630-410b-88c8-ce71e4f9eb32] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:31:40.700030 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-64e8b823-4952-4f60-86e6-85ae9101e3e8 tempest-VolumesNegativeTest-1214922722 tempest-VolumesNegativeTest-1214922722-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:31:40.700482 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-64e8b823-4952-4f60-86e6-85ae9101e3e8 tempest-VolumesNegativeTest-1214922722 tempest-VolumesNegativeTest-1214922722-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:31:40.701453 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-64e8b823-4952-4f60-86e6-85ae9101e3e8 tempest-VolumesNegativeTest-1214922722 tempest-VolumesNegativeTest-1214922722-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:31:40.703748 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-64e8b823-4952-4f60-86e6-85ae9101e3e8 tempest-VolumesNegativeTest-1214922722 tempest-VolumesNegativeTest-1214922722-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:31:40.908231 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-64e8b823-4952-4f60-86e6-85ae9101e3e8 tempest-VolumesNegativeTest-1214922722 tempest-VolumesNegativeTest-1214922722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a5ceff981447c4a65c0f2cec7607a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd9fedf211d41878c431ee91f87aaf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:31:40.920647 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-64e8b823-4952-4f60-86e6-85ae9101e3e8 tempest-VolumesNegativeTest-1214922722 tempest-VolumesNegativeTest-1214922722-project] 10.222.0.33 "GET /compute/v2.1/servers/afd07f97-a630-410b-88c8-ce71e4f9eb32" status: 200 len: 1315 microversion: 2.1 time: 0.234927 Jul 18 10:31:40.925509 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 193/381] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:31:40 2022] GET /compute/v2.1/servers/afd07f97-a630-410b-88c8-ce71e4f9eb32 => generated 1315 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:31:41.904055 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [req-9c28ed33-51c2-43e3-bfe2-9b0777f58177 req-872440c2-0093-43d9-85ac-63a79fc0525a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "afd07f97-a630-410b-88c8-ce71e4f9eb32", "tag": "8a18070f-25e3-4429-b290-643f2e4e970a"}]} {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:31:41.930359 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [req-9c28ed33-51c2-43e3-bfe2-9b0777f58177 req-872440c2-0093-43d9-85ac-63a79fc0525a service nova] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:31:41.931075 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [req-9c28ed33-51c2-43e3-bfe2-9b0777f58177 req-872440c2-0093-43d9-85ac-63a79fc0525a service nova] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:31:41.937925 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-db35b34d-38fb-4aa4-9f8d-483d31b21fe9 tempest-VolumesNegativeTest-1214922722 tempest-VolumesNegativeTest-1214922722-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:31:41.939116 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-db35b34d-38fb-4aa4-9f8d-483d31b21fe9 tempest-VolumesNegativeTest-1214922722 tempest-VolumesNegativeTest-1214922722-project] [instance: afd07f97-a630-410b-88c8-ce71e4f9eb32] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:31:41.950895 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-db35b34d-38fb-4aa4-9f8d-483d31b21fe9 tempest-VolumesNegativeTest-1214922722 tempest-VolumesNegativeTest-1214922722-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:31:41.951479 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-db35b34d-38fb-4aa4-9f8d-483d31b21fe9 tempest-VolumesNegativeTest-1214922722 tempest-VolumesNegativeTest-1214922722-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:31:41.955689 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-db35b34d-38fb-4aa4-9f8d-483d31b21fe9 tempest-VolumesNegativeTest-1214922722 tempest-VolumesNegativeTest-1214922722-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:31:41.956491 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-db35b34d-38fb-4aa4-9f8d-483d31b21fe9 tempest-VolumesNegativeTest-1214922722 tempest-VolumesNegativeTest-1214922722-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:31:41.962666 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.compute.server_external_events [req-9c28ed33-51c2-43e3-bfe2-9b0777f58177 req-872440c2-0093-43d9-85ac-63a79fc0525a service nova] Creating event network-changed:8a18070f-25e3-4429-b290-643f2e4e970a for instance afd07f97-a630-410b-88c8-ce71e4f9eb32 on hv-cinder-83754 Jul 18 10:31:41.972983 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [req-9c28ed33-51c2-43e3-bfe2-9b0777f58177 req-872440c2-0093-43d9-85ac-63a79fc0525a service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077287 Jul 18 10:31:41.977264 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 189/382] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jul 18 10:31:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:31:42.141977 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-db35b34d-38fb-4aa4-9f8d-483d31b21fe9 tempest-VolumesNegativeTest-1214922722 tempest-VolumesNegativeTest-1214922722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a5ceff981447c4a65c0f2cec7607a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd9fedf211d41878c431ee91f87aaf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:31:42.150141 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-db35b34d-38fb-4aa4-9f8d-483d31b21fe9 tempest-VolumesNegativeTest-1214922722 tempest-VolumesNegativeTest-1214922722-project] 10.222.0.33 "GET /compute/v2.1/servers/afd07f97-a630-410b-88c8-ce71e4f9eb32" status: 200 len: 1315 microversion: 2.1 time: 0.216179 Jul 18 10:31:42.152872 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 194/383] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:31:41 2022] GET /compute/v2.1/servers/afd07f97-a630-410b-88c8-ce71e4f9eb32 => generated 1315 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:31:43.170984 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-9d690e86-ceca-419c-8679-c3b5af041a0e tempest-VolumesNegativeTest-1214922722 tempest-VolumesNegativeTest-1214922722-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:31:43.171687 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-9d690e86-ceca-419c-8679-c3b5af041a0e tempest-VolumesNegativeTest-1214922722 tempest-VolumesNegativeTest-1214922722-project] [instance: afd07f97-a630-410b-88c8-ce71e4f9eb32] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:31:43.194800 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-9d690e86-ceca-419c-8679-c3b5af041a0e tempest-VolumesNegativeTest-1214922722 tempest-VolumesNegativeTest-1214922722-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:31:43.195595 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-9d690e86-ceca-419c-8679-c3b5af041a0e tempest-VolumesNegativeTest-1214922722 tempest-VolumesNegativeTest-1214922722-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:31:43.196459 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-9d690e86-ceca-419c-8679-c3b5af041a0e tempest-VolumesNegativeTest-1214922722 tempest-VolumesNegativeTest-1214922722-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:31:43.196932 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-9d690e86-ceca-419c-8679-c3b5af041a0e tempest-VolumesNegativeTest-1214922722 tempest-VolumesNegativeTest-1214922722-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:31:43.458153 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-9d690e86-ceca-419c-8679-c3b5af041a0e tempest-VolumesNegativeTest-1214922722 tempest-VolumesNegativeTest-1214922722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a5ceff981447c4a65c0f2cec7607a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd9fedf211d41878c431ee91f87aaf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:31:43.471450 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-9d690e86-ceca-419c-8679-c3b5af041a0e tempest-VolumesNegativeTest-1214922722 tempest-VolumesNegativeTest-1214922722-project] 10.222.0.33 "GET /compute/v2.1/servers/afd07f97-a630-410b-88c8-ce71e4f9eb32" status: 200 len: 1315 microversion: 2.1 time: 0.308078 Jul 18 10:31:43.472040 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 190/384] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:31:43 2022] GET /compute/v2.1/servers/afd07f97-a630-410b-88c8-ce71e4f9eb32 => generated 1315 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:31:44.489787 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-da3cabd3-32a5-44b4-9be0-519c56bb0b6b tempest-VolumesNegativeTest-1214922722 tempest-VolumesNegativeTest-1214922722-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:31:44.490690 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-da3cabd3-32a5-44b4-9be0-519c56bb0b6b tempest-VolumesNegativeTest-1214922722 tempest-VolumesNegativeTest-1214922722-project] [instance: afd07f97-a630-410b-88c8-ce71e4f9eb32] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:31:44.506345 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-da3cabd3-32a5-44b4-9be0-519c56bb0b6b tempest-VolumesNegativeTest-1214922722 tempest-VolumesNegativeTest-1214922722-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:31:44.506801 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-da3cabd3-32a5-44b4-9be0-519c56bb0b6b tempest-VolumesNegativeTest-1214922722 tempest-VolumesNegativeTest-1214922722-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:31:44.507590 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-da3cabd3-32a5-44b4-9be0-519c56bb0b6b tempest-VolumesNegativeTest-1214922722 tempest-VolumesNegativeTest-1214922722-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:31:44.508021 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-da3cabd3-32a5-44b4-9be0-519c56bb0b6b tempest-VolumesNegativeTest-1214922722 tempest-VolumesNegativeTest-1214922722-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:31:44.821868 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-da3cabd3-32a5-44b4-9be0-519c56bb0b6b tempest-VolumesNegativeTest-1214922722 tempest-VolumesNegativeTest-1214922722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a5ceff981447c4a65c0f2cec7607a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd9fedf211d41878c431ee91f87aaf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:31:44.832561 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-da3cabd3-32a5-44b4-9be0-519c56bb0b6b tempest-VolumesNegativeTest-1214922722 tempest-VolumesNegativeTest-1214922722-project] 10.222.0.33 "GET /compute/v2.1/servers/afd07f97-a630-410b-88c8-ce71e4f9eb32" status: 200 len: 1315 microversion: 2.1 time: 0.346838 Jul 18 10:31:44.833414 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 195/385] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:31:44 2022] GET /compute/v2.1/servers/afd07f97-a630-410b-88c8-ce71e4f9eb32 => generated 1315 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:31:45.849572 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-c95dbc79-4f9b-4f20-9370-08bc7f132e78 tempest-VolumesNegativeTest-1214922722 tempest-VolumesNegativeTest-1214922722-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:31:45.851054 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-c95dbc79-4f9b-4f20-9370-08bc7f132e78 tempest-VolumesNegativeTest-1214922722 tempest-VolumesNegativeTest-1214922722-project] [instance: afd07f97-a630-410b-88c8-ce71e4f9eb32] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:31:45.861148 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-c95dbc79-4f9b-4f20-9370-08bc7f132e78 tempest-VolumesNegativeTest-1214922722 tempest-VolumesNegativeTest-1214922722-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:31:45.862011 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-c95dbc79-4f9b-4f20-9370-08bc7f132e78 tempest-VolumesNegativeTest-1214922722 tempest-VolumesNegativeTest-1214922722-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:31:45.863085 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-c95dbc79-4f9b-4f20-9370-08bc7f132e78 tempest-VolumesNegativeTest-1214922722 tempest-VolumesNegativeTest-1214922722-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:31:45.863695 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-c95dbc79-4f9b-4f20-9370-08bc7f132e78 tempest-VolumesNegativeTest-1214922722 tempest-VolumesNegativeTest-1214922722-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:31:46.089705 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-c95dbc79-4f9b-4f20-9370-08bc7f132e78 tempest-VolumesNegativeTest-1214922722 tempest-VolumesNegativeTest-1214922722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a5ceff981447c4a65c0f2cec7607a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd9fedf211d41878c431ee91f87aaf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:31:46.099303 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-c95dbc79-4f9b-4f20-9370-08bc7f132e78 tempest-VolumesNegativeTest-1214922722 tempest-VolumesNegativeTest-1214922722-project] 10.222.0.33 "GET /compute/v2.1/servers/afd07f97-a630-410b-88c8-ce71e4f9eb32" status: 200 len: 1315 microversion: 2.1 time: 0.253500 Jul 18 10:31:46.100168 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 191/386] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:31:45 2022] GET /compute/v2.1/servers/afd07f97-a630-410b-88c8-ce71e4f9eb32 => generated 1315 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:31:47.119465 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-3da8884e-a366-4523-9b64-3641c3711a78 tempest-VolumesNegativeTest-1214922722 tempest-VolumesNegativeTest-1214922722-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:31:47.120707 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-3da8884e-a366-4523-9b64-3641c3711a78 tempest-VolumesNegativeTest-1214922722 tempest-VolumesNegativeTest-1214922722-project] [instance: afd07f97-a630-410b-88c8-ce71e4f9eb32] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:31:47.127508 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG dbcounter [-] [117879] Writing DB stats nova_cell0:SELECT=2 {{(pid=117879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:31:47.129109 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-3da8884e-a366-4523-9b64-3641c3711a78 tempest-VolumesNegativeTest-1214922722 tempest-VolumesNegativeTest-1214922722-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:31:47.130758 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-3da8884e-a366-4523-9b64-3641c3711a78 tempest-VolumesNegativeTest-1214922722 tempest-VolumesNegativeTest-1214922722-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:31:47.130758 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-3da8884e-a366-4523-9b64-3641c3711a78 tempest-VolumesNegativeTest-1214922722 tempest-VolumesNegativeTest-1214922722-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:31:47.131355 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-3da8884e-a366-4523-9b64-3641c3711a78 tempest-VolumesNegativeTest-1214922722 tempest-VolumesNegativeTest-1214922722-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:31:47.308914 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-3da8884e-a366-4523-9b64-3641c3711a78 tempest-VolumesNegativeTest-1214922722 tempest-VolumesNegativeTest-1214922722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a5ceff981447c4a65c0f2cec7607a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd9fedf211d41878c431ee91f87aaf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:31:47.317964 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-3da8884e-a366-4523-9b64-3641c3711a78 tempest-VolumesNegativeTest-1214922722 tempest-VolumesNegativeTest-1214922722-project] 10.222.0.33 "GET /compute/v2.1/servers/afd07f97-a630-410b-88c8-ce71e4f9eb32" status: 200 len: 1315 microversion: 2.1 time: 0.202870 Jul 18 10:31:47.318757 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 196/387] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:31:47 2022] GET /compute/v2.1/servers/afd07f97-a630-410b-88c8-ce71e4f9eb32 => generated 1315 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:31:47.894452 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-37293822-bed8-4bd4-9e0c-68b94d519934 tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1863887917", "imageRef": "2cb02169-9999-411b-8c74-f88c068960fc", "flavorRef": "452", "networks": [{"uuid": "303a42e4-0390-40fa-955b-4c7e6e4064b3"}]}} {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:31:47.961992 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.network.neutron [None req-37293822-bed8-4bd4-9e0c-68b94d519934 tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] validate_networks() for [('303a42e4-0390-40fa-955b-4c7e6e4064b3', None, None, None, None, None)] {{(pid=117880) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 10:31:48.335575 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-a8f972b0-08a6-4095-b26f-571bc414db35 tempest-VolumesNegativeTest-1214922722 tempest-VolumesNegativeTest-1214922722-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:31:48.336182 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-a8f972b0-08a6-4095-b26f-571bc414db35 tempest-VolumesNegativeTest-1214922722 tempest-VolumesNegativeTest-1214922722-project] [instance: afd07f97-a630-410b-88c8-ce71e4f9eb32] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:31:48.341735 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG dbcounter [-] [117879] Writing DB stats nova_cell0:SELECT=8 {{(pid=117879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:31:48.344837 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-a8f972b0-08a6-4095-b26f-571bc414db35 tempest-VolumesNegativeTest-1214922722 tempest-VolumesNegativeTest-1214922722-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:31:48.345500 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-a8f972b0-08a6-4095-b26f-571bc414db35 tempest-VolumesNegativeTest-1214922722 tempest-VolumesNegativeTest-1214922722-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:31:48.346442 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-a8f972b0-08a6-4095-b26f-571bc414db35 tempest-VolumesNegativeTest-1214922722 tempest-VolumesNegativeTest-1214922722-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:31:48.347033 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-a8f972b0-08a6-4095-b26f-571bc414db35 tempest-VolumesNegativeTest-1214922722 tempest-VolumesNegativeTest-1214922722-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:31:48.444817 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.virt.hardware [None req-37293822-bed8-4bd4-9e0c-68b94d519934 tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Flavor limits 0:0:0 {{(pid=117880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 10:31:48.445243 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.virt.hardware [None req-37293822-bed8-4bd4-9e0c-68b94d519934 tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Image limits 0:0:0 {{(pid=117880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 10:31:48.446104 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.virt.hardware [None req-37293822-bed8-4bd4-9e0c-68b94d519934 tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Flavor pref 0:0:0 {{(pid=117880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 10:31:48.446684 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.virt.hardware [None req-37293822-bed8-4bd4-9e0c-68b94d519934 tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Image pref 0:0:0 {{(pid=117880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 10:31:48.447258 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.virt.hardware [None req-37293822-bed8-4bd4-9e0c-68b94d519934 tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 10:31:48.467970 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-37293822-bed8-4bd4-9e0c-68b94d519934 tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:31:48.468730 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-37293822-bed8-4bd4-9e0c-68b94d519934 tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:31:48.469732 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-37293822-bed8-4bd4-9e0c-68b94d519934 tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:31:48.470320 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-37293822-bed8-4bd4-9e0c-68b94d519934 tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:31:48.491573 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.quota [None req-37293822-bed8-4bd4-9e0c-68b94d519934 tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Getting quotas for project ee6203312784435b8cd1fdfede3fb597. Resources: {'ram', 'cores', 'instances'} {{(pid=117880) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 10:31:48.495917 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.quota [None req-37293822-bed8-4bd4-9e0c-68b94d519934 tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Getting quotas for user 8c9439cb644548b8b3b5fd5c610757b9 and project ee6203312784435b8cd1fdfede3fb597. Resources: {'ram', 'cores', 'instances'} {{(pid=117880) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 10:31:48.511248 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-37293822-bed8-4bd4-9e0c-68b94d519934 tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Going to run 1 instances... {{(pid=117880) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 10:31:48.513836 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-37293822-bed8-4bd4-9e0c-68b94d519934 tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] [instance: a6d1079b-c5d3-4062-9759-b681711cef09] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2cb02169-9999-411b-8c74-f88c068960fc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117880) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 10:31:48.519625 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-a8f972b0-08a6-4095-b26f-571bc414db35 tempest-VolumesNegativeTest-1214922722 tempest-VolumesNegativeTest-1214922722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a5ceff981447c4a65c0f2cec7607a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd9fedf211d41878c431ee91f87aaf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:31:48.529746 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-a8f972b0-08a6-4095-b26f-571bc414db35 tempest-VolumesNegativeTest-1214922722 tempest-VolumesNegativeTest-1214922722-project] 10.222.0.33 "GET /compute/v2.1/servers/afd07f97-a630-410b-88c8-ce71e4f9eb32" status: 200 len: 1315 microversion: 2.1 time: 0.198179 Jul 18 10:31:48.539437 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 197/388] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:31:48 2022] GET /compute/v2.1/servers/afd07f97-a630-410b-88c8-ce71e4f9eb32 => generated 1315 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:31:48.579653 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-37293822-bed8-4bd4-9e0c-68b94d519934 tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.688627 Jul 18 10:31:48.581114 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 192/389] 10.222.0.33 () {60 vars in 1146 bytes} [Mon Jul 18 10:31:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 691 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 10:31:48.611274 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-59da87e0-948c-4cbc-8df1-fac30c143bf8 tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:31:48.612153 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-59da87e0-948c-4cbc-8df1-fac30c143bf8 tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] [instance: a6d1079b-c5d3-4062-9759-b681711cef09] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:31:48.709697 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-59da87e0-948c-4cbc-8df1-fac30c143bf8 tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c9439cb644548b8b3b5fd5c610757b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6203312784435b8cd1fdfede3fb597', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:31:48.718955 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-59da87e0-948c-4cbc-8df1-fac30c143bf8 tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] 10.222.0.33 "GET /compute/v2.1/servers/a6d1079b-c5d3-4062-9759-b681711cef09" status: 200 len: 1219 microversion: 2.1 time: 0.131258 Jul 18 10:31:48.720180 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 198/390] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:31:48 2022] GET /compute/v2.1/servers/a6d1079b-c5d3-4062-9759-b681711cef09 => generated 1219 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:31:49.546672 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-053a813c-8e5a-45a4-9feb-65bd02a5d12a tempest-VolumesNegativeTest-1214922722 tempest-VolumesNegativeTest-1214922722-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:31:49.548660 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-053a813c-8e5a-45a4-9feb-65bd02a5d12a tempest-VolumesNegativeTest-1214922722 tempest-VolumesNegativeTest-1214922722-project] [instance: afd07f97-a630-410b-88c8-ce71e4f9eb32] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:31:49.557637 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-053a813c-8e5a-45a4-9feb-65bd02a5d12a tempest-VolumesNegativeTest-1214922722 tempest-VolumesNegativeTest-1214922722-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:31:49.558310 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-053a813c-8e5a-45a4-9feb-65bd02a5d12a tempest-VolumesNegativeTest-1214922722 tempest-VolumesNegativeTest-1214922722-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:31:49.559306 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-053a813c-8e5a-45a4-9feb-65bd02a5d12a tempest-VolumesNegativeTest-1214922722 tempest-VolumesNegativeTest-1214922722-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:31:49.559809 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-053a813c-8e5a-45a4-9feb-65bd02a5d12a tempest-VolumesNegativeTest-1214922722 tempest-VolumesNegativeTest-1214922722-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:31:49.729288 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-053a813c-8e5a-45a4-9feb-65bd02a5d12a tempest-VolumesNegativeTest-1214922722 tempest-VolumesNegativeTest-1214922722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a5ceff981447c4a65c0f2cec7607a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd9fedf211d41878c431ee91f87aaf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:31:49.737438 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-053a813c-8e5a-45a4-9feb-65bd02a5d12a tempest-VolumesNegativeTest-1214922722 tempest-VolumesNegativeTest-1214922722-project] 10.222.0.33 "GET /compute/v2.1/servers/afd07f97-a630-410b-88c8-ce71e4f9eb32" status: 200 len: 1315 microversion: 2.1 time: 0.194770 Jul 18 10:31:49.737922 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-f1c3f8e7-944e-46aa-9da9-c5d9c942a043 tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:31:49.738551 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-f1c3f8e7-944e-46aa-9da9-c5d9c942a043 tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] [instance: a6d1079b-c5d3-4062-9759-b681711cef09] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:31:49.739741 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 193/391] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:31:49 2022] GET /compute/v2.1/servers/afd07f97-a630-410b-88c8-ce71e4f9eb32 => generated 1315 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:31:49.742442 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG dbcounter [-] [117879] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=3 {{(pid=117879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:31:49.747933 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-f1c3f8e7-944e-46aa-9da9-c5d9c942a043 tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:31:49.748803 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-f1c3f8e7-944e-46aa-9da9-c5d9c942a043 tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:31:49.749818 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-f1c3f8e7-944e-46aa-9da9-c5d9c942a043 tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:31:49.751000 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-f1c3f8e7-944e-46aa-9da9-c5d9c942a043 tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:31:49.846484 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-3a6701e6-b9f3-4dce-b5f4-89ccc28f2d4b tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Action: 'create', calling method: .version_select at 0x7f9f4a070e50>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-2096645998", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOTIStDLjLH78iakCwIHqLw4RR9andUvPd/bYdrdKVllRWftQN6iW8WaySGoek7rycN593KY3tz+MyIr0qWuR/8Kbin9CoOIRWj+av+PvcsxB6NB8DT0i96TchWMnYxPqw=="}} {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:31:49.850471 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-f1c3f8e7-944e-46aa-9da9-c5d9c942a043 tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c9439cb644548b8b3b5fd5c610757b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6203312784435b8cd1fdfede3fb597', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:31:49.860936 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-f1c3f8e7-944e-46aa-9da9-c5d9c942a043 tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] 10.222.0.33 "GET /compute/v2.1/servers/a6d1079b-c5d3-4062-9759-b681711cef09" status: 200 len: 1279 microversion: 2.1 time: 0.127385 Jul 18 10:31:49.863596 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 199/392] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:31:49 2022] GET /compute/v2.1/servers/a6d1079b-c5d3-4062-9759-b681711cef09 => generated 1279 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:31:49.868987 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.quota [None req-3a6701e6-b9f3-4dce-b5f4-89ccc28f2d4b tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Getting quotas for project f62ef510c8484995a2f31f29104f399f. Resources: {'key_pairs'} {{(pid=117880) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 10:31:49.873476 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.quota [None req-3a6701e6-b9f3-4dce-b5f4-89ccc28f2d4b tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Getting quotas for user 1af30265de71409d876112350949a2a4 and project f62ef510c8484995a2f31f29104f399f. Resources: {'key_pairs'} {{(pid=117880) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 10:31:49.919715 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-3a6701e6-b9f3-4dce-b5f4-89ccc28f2d4b tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.080983 Jul 18 10:31:49.943991 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 194/393] 10.222.0.33 () {60 vars in 1158 bytes} [Mon Jul 18 10:31:49 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:31:49.996048 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-b1edc5fc-fac3-44cd-8bef-337f34c11d10 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1400466527", "imageRef": "5d156a0f-157c-430a-a127-ce47c9a4b5b2", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-2096645998", "networks": [{"uuid": "2ad8bb67-e0de-4ff2-b2c4-142f0b4e768c"}]}} {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:31:50.085778 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.network.neutron [None req-b1edc5fc-fac3-44cd-8bef-337f34c11d10 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] validate_networks() for [('2ad8bb67-e0de-4ff2-b2c4-142f0b4e768c', None, None, None, None, None)] {{(pid=117879) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 10:31:50.207812 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [req-8a345f34-3067-4fa9-bfcd-a278cf80e6eb req-1a2a4182-7b80-47e0-94a1-edcf3920b306 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "afd07f97-a630-410b-88c8-ce71e4f9eb32", "name": "network-vif-plugged", "status": "completed", "tag": "8a18070f-25e3-4429-b290-643f2e4e970a"}]} {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:31:50.217101 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [req-8a345f34-3067-4fa9-bfcd-a278cf80e6eb req-1a2a4182-7b80-47e0-94a1-edcf3920b306 service nova] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:31:50.217526 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [req-8a345f34-3067-4fa9-bfcd-a278cf80e6eb req-1a2a4182-7b80-47e0-94a1-edcf3920b306 service nova] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:31:50.230071 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.compute.server_external_events [req-8a345f34-3067-4fa9-bfcd-a278cf80e6eb req-1a2a4182-7b80-47e0-94a1-edcf3920b306 service nova] Creating event network-vif-plugged:8a18070f-25e3-4429-b290-643f2e4e970a for instance afd07f97-a630-410b-88c8-ce71e4f9eb32 on hv-cinder-83754 Jul 18 10:31:50.235426 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [req-8a345f34-3067-4fa9-bfcd-a278cf80e6eb req-1a2a4182-7b80-47e0-94a1-edcf3920b306 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032442 Jul 18 10:31:50.236135 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 195/394] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jul 18 10:31:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 10:31:50.756750 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-8e32484f-2f27-4a1e-92fc-f3c679402a60 tempest-VolumesNegativeTest-1214922722 tempest-VolumesNegativeTest-1214922722-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:31:50.757375 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-8e32484f-2f27-4a1e-92fc-f3c679402a60 tempest-VolumesNegativeTest-1214922722 tempest-VolumesNegativeTest-1214922722-project] [instance: afd07f97-a630-410b-88c8-ce71e4f9eb32] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:31:50.763741 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-8e32484f-2f27-4a1e-92fc-f3c679402a60 tempest-VolumesNegativeTest-1214922722 tempest-VolumesNegativeTest-1214922722-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:31:50.764182 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-8e32484f-2f27-4a1e-92fc-f3c679402a60 tempest-VolumesNegativeTest-1214922722 tempest-VolumesNegativeTest-1214922722-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:31:50.764974 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-8e32484f-2f27-4a1e-92fc-f3c679402a60 tempest-VolumesNegativeTest-1214922722 tempest-VolumesNegativeTest-1214922722-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:31:50.765403 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-8e32484f-2f27-4a1e-92fc-f3c679402a60 tempest-VolumesNegativeTest-1214922722 tempest-VolumesNegativeTest-1214922722-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:31:51.091208 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.virt.hardware [None req-b1edc5fc-fac3-44cd-8bef-337f34c11d10 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Flavor limits 0:0:0 {{(pid=117879) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 10:31:51.091722 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.virt.hardware [None req-b1edc5fc-fac3-44cd-8bef-337f34c11d10 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Image limits 0:0:0 {{(pid=117879) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 10:31:51.092083 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.virt.hardware [None req-b1edc5fc-fac3-44cd-8bef-337f34c11d10 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Flavor pref 0:0:0 {{(pid=117879) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 10:31:51.092483 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.virt.hardware [None req-b1edc5fc-fac3-44cd-8bef-337f34c11d10 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Image pref 0:0:0 {{(pid=117879) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 10:31:51.093080 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.virt.hardware [None req-b1edc5fc-fac3-44cd-8bef-337f34c11d10 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117879) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 10:31:51.097580 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-8e32484f-2f27-4a1e-92fc-f3c679402a60 tempest-VolumesNegativeTest-1214922722 tempest-VolumesNegativeTest-1214922722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a5ceff981447c4a65c0f2cec7607a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd9fedf211d41878c431ee91f87aaf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:31:51.103316 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-b1edc5fc-fac3-44cd-8bef-337f34c11d10 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:31:51.103925 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-b1edc5fc-fac3-44cd-8bef-337f34c11d10 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:31:51.104740 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-b1edc5fc-fac3-44cd-8bef-337f34c11d10 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:31:51.105180 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-b1edc5fc-fac3-44cd-8bef-337f34c11d10 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:31:51.107143 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-8e32484f-2f27-4a1e-92fc-f3c679402a60 tempest-VolumesNegativeTest-1214922722 tempest-VolumesNegativeTest-1214922722-project] 10.222.0.33 "GET /compute/v2.1/servers/afd07f97-a630-410b-88c8-ce71e4f9eb32" status: 200 len: 1315 microversion: 2.1 time: 0.354789 Jul 18 10:31:51.116124 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 196/395] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:31:50 2022] GET /compute/v2.1/servers/afd07f97-a630-410b-88c8-ce71e4f9eb32 => generated 1315 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:31:51.120779 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-7e309636-12aa-4510-a7d0-6d7885129627 tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:31:51.121392 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-7e309636-12aa-4510-a7d0-6d7885129627 tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] [instance: a6d1079b-c5d3-4062-9759-b681711cef09] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:31:51.123612 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.quota [None req-b1edc5fc-fac3-44cd-8bef-337f34c11d10 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Getting quotas for project f62ef510c8484995a2f31f29104f399f. Resources: {'ram', 'cores', 'instances'} {{(pid=117879) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 10:31:51.127432 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-7e309636-12aa-4510-a7d0-6d7885129627 tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:31:51.127768 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.quota [None req-b1edc5fc-fac3-44cd-8bef-337f34c11d10 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Getting quotas for user 1af30265de71409d876112350949a2a4 and project f62ef510c8484995a2f31f29104f399f. Resources: {'ram', 'cores', 'instances'} {{(pid=117879) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 10:31:51.127879 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-7e309636-12aa-4510-a7d0-6d7885129627 tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:31:51.128658 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-7e309636-12aa-4510-a7d0-6d7885129627 tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:31:51.129087 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-7e309636-12aa-4510-a7d0-6d7885129627 tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:31:51.139808 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-b1edc5fc-fac3-44cd-8bef-337f34c11d10 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Going to run 1 instances... {{(pid=117879) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 10:31:51.144152 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-b1edc5fc-fac3-44cd-8bef-337f34c11d10 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] [instance: 83b29c39-45ca-4cb3-ad7d-f7bd47bfe667] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5d156a0f-157c-430a-a127-ce47c9a4b5b2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117879) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 10:31:51.197033 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-b1edc5fc-fac3-44cd-8bef-337f34c11d10 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.208380 Jul 18 10:31:51.198057 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 200/396] 10.222.0.33 () {60 vars in 1146 bytes} [Mon Jul 18 10:31:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 1211 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 10:31:51.208539 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-0170c756-2f5f-441c-a75d-52c7bdea5f04 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:31:51.209709 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-0170c756-2f5f-441c-a75d-52c7bdea5f04 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] [instance: 83b29c39-45ca-4cb3-ad7d-f7bd47bfe667] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:31:51.289225 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-0170c756-2f5f-441c-a75d-52c7bdea5f04 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af30265de71409d876112350949a2a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f62ef510c8484995a2f31f29104f399f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:31:51.297652 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-0170c756-2f5f-441c-a75d-52c7bdea5f04 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] 10.222.0.33 "GET /compute/v2.1/servers/83b29c39-45ca-4cb3-ad7d-f7bd47bfe667" status: 200 len: 1259 microversion: 2.1 time: 0.093932 Jul 18 10:31:51.298682 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 201/397] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:31:51 2022] GET /compute/v2.1/servers/83b29c39-45ca-4cb3-ad7d-f7bd47bfe667 => generated 1259 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:31:51.396674 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-7e309636-12aa-4510-a7d0-6d7885129627 tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c9439cb644548b8b3b5fd5c610757b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6203312784435b8cd1fdfede3fb597', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:31:51.403841 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-7e309636-12aa-4510-a7d0-6d7885129627 tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] 10.222.0.33 "GET /compute/v2.1/servers/a6d1079b-c5d3-4062-9759-b681711cef09" status: 200 len: 1319 microversion: 2.1 time: 0.286718 Jul 18 10:31:51.404671 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 197/398] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:31:51 2022] GET /compute/v2.1/servers/a6d1079b-c5d3-4062-9759-b681711cef09 => generated 1319 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:31:52.123272 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-72ba1d28-6706-40af-8992-f1d6680ce1d8 tempest-VolumesNegativeTest-1214922722 tempest-VolumesNegativeTest-1214922722-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:31:52.124005 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-72ba1d28-6706-40af-8992-f1d6680ce1d8 tempest-VolumesNegativeTest-1214922722 tempest-VolumesNegativeTest-1214922722-project] [instance: afd07f97-a630-410b-88c8-ce71e4f9eb32] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:31:52.131266 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-72ba1d28-6706-40af-8992-f1d6680ce1d8 tempest-VolumesNegativeTest-1214922722 tempest-VolumesNegativeTest-1214922722-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:31:52.131860 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-72ba1d28-6706-40af-8992-f1d6680ce1d8 tempest-VolumesNegativeTest-1214922722 tempest-VolumesNegativeTest-1214922722-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:31:52.133197 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-72ba1d28-6706-40af-8992-f1d6680ce1d8 tempest-VolumesNegativeTest-1214922722 tempest-VolumesNegativeTest-1214922722-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:31:52.133679 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-72ba1d28-6706-40af-8992-f1d6680ce1d8 tempest-VolumesNegativeTest-1214922722 tempest-VolumesNegativeTest-1214922722-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:31:52.317351 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-9e8c0e3d-28fb-4c1d-8d08-6dc395066f82 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:31:52.317778 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-9e8c0e3d-28fb-4c1d-8d08-6dc395066f82 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] [instance: 83b29c39-45ca-4cb3-ad7d-f7bd47bfe667] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:31:52.331292 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-9e8c0e3d-28fb-4c1d-8d08-6dc395066f82 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:31:52.331772 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-9e8c0e3d-28fb-4c1d-8d08-6dc395066f82 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:31:52.332584 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-9e8c0e3d-28fb-4c1d-8d08-6dc395066f82 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:31:52.333215 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-9e8c0e3d-28fb-4c1d-8d08-6dc395066f82 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:31:52.385447 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-72ba1d28-6706-40af-8992-f1d6680ce1d8 tempest-VolumesNegativeTest-1214922722 tempest-VolumesNegativeTest-1214922722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a5ceff981447c4a65c0f2cec7607a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd9fedf211d41878c431ee91f87aaf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:31:52.393635 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-72ba1d28-6706-40af-8992-f1d6680ce1d8 tempest-VolumesNegativeTest-1214922722 tempest-VolumesNegativeTest-1214922722-project] 10.222.0.33 "GET /compute/v2.1/servers/afd07f97-a630-410b-88c8-ce71e4f9eb32" status: 200 len: 1315 microversion: 2.1 time: 0.274334 Jul 18 10:31:52.394199 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 202/399] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:31:52 2022] GET /compute/v2.1/servers/afd07f97-a630-410b-88c8-ce71e4f9eb32 => generated 1315 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:31:52.405295 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-9e8c0e3d-28fb-4c1d-8d08-6dc395066f82 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af30265de71409d876112350949a2a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f62ef510c8484995a2f31f29104f399f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:31:52.412839 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-9e8c0e3d-28fb-4c1d-8d08-6dc395066f82 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] 10.222.0.33 "GET /compute/v2.1/servers/83b29c39-45ca-4cb3-ad7d-f7bd47bfe667" status: 200 len: 1255 microversion: 2.1 time: 0.102060 Jul 18 10:31:52.413567 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 198/400] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:31:52 2022] GET /compute/v2.1/servers/83b29c39-45ca-4cb3-ad7d-f7bd47bfe667 => generated 1255 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:31:52.421229 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-78cf7599-0a5e-441d-8908-e0f29cf839e5 tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:31:52.421910 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-78cf7599-0a5e-441d-8908-e0f29cf839e5 tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] [instance: a6d1079b-c5d3-4062-9759-b681711cef09] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:31:52.428558 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-78cf7599-0a5e-441d-8908-e0f29cf839e5 tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:31:52.429116 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-78cf7599-0a5e-441d-8908-e0f29cf839e5 tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:31:52.429988 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-78cf7599-0a5e-441d-8908-e0f29cf839e5 tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:31:52.430424 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-78cf7599-0a5e-441d-8908-e0f29cf839e5 tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:31:52.603553 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [req-41cd06b8-1b42-4a24-98cc-a2dc958e7e91 req-4c5a4dd1-189d-4169-bcca-2a0c482da46a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a6d1079b-c5d3-4062-9759-b681711cef09", "tag": "6a2188b8-537d-4141-bb7c-a4099429ba7c"}]} {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:31:52.611740 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [req-41cd06b8-1b42-4a24-98cc-a2dc958e7e91 req-4c5a4dd1-189d-4169-bcca-2a0c482da46a service nova] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:31:52.612182 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [req-41cd06b8-1b42-4a24-98cc-a2dc958e7e91 req-4c5a4dd1-189d-4169-bcca-2a0c482da46a service nova] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:31:52.623199 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.compute.server_external_events [req-41cd06b8-1b42-4a24-98cc-a2dc958e7e91 req-4c5a4dd1-189d-4169-bcca-2a0c482da46a service nova] Creating event network-changed:6a2188b8-537d-4141-bb7c-a4099429ba7c for instance a6d1079b-c5d3-4062-9759-b681711cef09 on hv-cinder-83754 Jul 18 10:31:52.629489 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-78cf7599-0a5e-441d-8908-e0f29cf839e5 tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c9439cb644548b8b3b5fd5c610757b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6203312784435b8cd1fdfede3fb597', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:31:52.635669 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [req-41cd06b8-1b42-4a24-98cc-a2dc958e7e91 req-4c5a4dd1-189d-4169-bcca-2a0c482da46a service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035470 Jul 18 10:31:52.636954 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 199/401] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jul 18 10:31:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:31:52.637831 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-78cf7599-0a5e-441d-8908-e0f29cf839e5 tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] 10.222.0.33 "GET /compute/v2.1/servers/a6d1079b-c5d3-4062-9759-b681711cef09" status: 200 len: 1319 microversion: 2.1 time: 0.220290 Jul 18 10:31:52.638921 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 203/402] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:31:52 2022] GET /compute/v2.1/servers/a6d1079b-c5d3-4062-9759-b681711cef09 => generated 1319 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:31:53.410871 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-8c68a9b3-29dc-4d25-af1e-18b2db32a68f tempest-VolumesNegativeTest-1214922722 tempest-VolumesNegativeTest-1214922722-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:31:53.411559 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-8c68a9b3-29dc-4d25-af1e-18b2db32a68f tempest-VolumesNegativeTest-1214922722 tempest-VolumesNegativeTest-1214922722-project] [instance: afd07f97-a630-410b-88c8-ce71e4f9eb32] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:31:53.417978 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-8c68a9b3-29dc-4d25-af1e-18b2db32a68f tempest-VolumesNegativeTest-1214922722 tempest-VolumesNegativeTest-1214922722-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:31:53.418422 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-8c68a9b3-29dc-4d25-af1e-18b2db32a68f tempest-VolumesNegativeTest-1214922722 tempest-VolumesNegativeTest-1214922722-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:31:53.419180 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-8c68a9b3-29dc-4d25-af1e-18b2db32a68f tempest-VolumesNegativeTest-1214922722 tempest-VolumesNegativeTest-1214922722-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:31:53.419610 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-8c68a9b3-29dc-4d25-af1e-18b2db32a68f tempest-VolumesNegativeTest-1214922722 tempest-VolumesNegativeTest-1214922722-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:31:53.430571 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-f178d0b8-28c6-4e37-9027-341715084413 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:31:53.431259 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-f178d0b8-28c6-4e37-9027-341715084413 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] [instance: 83b29c39-45ca-4cb3-ad7d-f7bd47bfe667] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:31:53.438464 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-f178d0b8-28c6-4e37-9027-341715084413 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:31:53.438939 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-f178d0b8-28c6-4e37-9027-341715084413 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:31:53.439697 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-f178d0b8-28c6-4e37-9027-341715084413 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:31:53.440129 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-f178d0b8-28c6-4e37-9027-341715084413 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:31:53.514878 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-f178d0b8-28c6-4e37-9027-341715084413 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af30265de71409d876112350949a2a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f62ef510c8484995a2f31f29104f399f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:31:53.522431 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-f178d0b8-28c6-4e37-9027-341715084413 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] 10.222.0.33 "GET /compute/v2.1/servers/83b29c39-45ca-4cb3-ad7d-f7bd47bfe667" status: 200 len: 1311 microversion: 2.1 time: 0.095710 Jul 18 10:31:53.522998 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 204/403] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:31:53 2022] GET /compute/v2.1/servers/83b29c39-45ca-4cb3-ad7d-f7bd47bfe667 => generated 1311 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:31:53.590883 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-8c68a9b3-29dc-4d25-af1e-18b2db32a68f tempest-VolumesNegativeTest-1214922722 tempest-VolumesNegativeTest-1214922722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a5ceff981447c4a65c0f2cec7607a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd9fedf211d41878c431ee91f87aaf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:31:53.599440 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-8c68a9b3-29dc-4d25-af1e-18b2db32a68f tempest-VolumesNegativeTest-1214922722 tempest-VolumesNegativeTest-1214922722-project] 10.222.0.33 "GET /compute/v2.1/servers/afd07f97-a630-410b-88c8-ce71e4f9eb32" status: 200 len: 1465 microversion: 2.1 time: 0.193000 Jul 18 10:31:53.600524 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 200/404] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:31:53 2022] GET /compute/v2.1/servers/afd07f97-a630-410b-88c8-ce71e4f9eb32 => generated 1465 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:31:53.643853 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-584f3915-1631-418b-a0a7-ea939977b210 tempest-VolumesNegativeTest-1214922722 tempest-VolumesNegativeTest-1214922722-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:31:53.644834 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-584f3915-1631-418b-a0a7-ea939977b210 tempest-VolumesNegativeTest-1214922722 tempest-VolumesNegativeTest-1214922722-project] [instance: afd07f97-a630-410b-88c8-ce71e4f9eb32] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:31:53.660122 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-584f3915-1631-418b-a0a7-ea939977b210 tempest-VolumesNegativeTest-1214922722 tempest-VolumesNegativeTest-1214922722-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:31:53.661311 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-5eb29396-1b9f-4b09-96d4-6baa9b4b1237 tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:31:53.662102 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-5eb29396-1b9f-4b09-96d4-6baa9b4b1237 tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] [instance: a6d1079b-c5d3-4062-9759-b681711cef09] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:31:53.662735 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-584f3915-1631-418b-a0a7-ea939977b210 tempest-VolumesNegativeTest-1214922722 tempest-VolumesNegativeTest-1214922722-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:31:53.664740 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-584f3915-1631-418b-a0a7-ea939977b210 tempest-VolumesNegativeTest-1214922722 tempest-VolumesNegativeTest-1214922722-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:31:53.666519 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-584f3915-1631-418b-a0a7-ea939977b210 tempest-VolumesNegativeTest-1214922722 tempest-VolumesNegativeTest-1214922722-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:31:53.678373 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-5eb29396-1b9f-4b09-96d4-6baa9b4b1237 tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:31:53.678944 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-5eb29396-1b9f-4b09-96d4-6baa9b4b1237 tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:31:53.679784 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-5eb29396-1b9f-4b09-96d4-6baa9b4b1237 tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:31:53.680285 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-5eb29396-1b9f-4b09-96d4-6baa9b4b1237 tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:31:53.702504 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-584f3915-1631-418b-a0a7-ea939977b210 tempest-VolumesNegativeTest-1214922722 tempest-VolumesNegativeTest-1214922722-project] [instance: afd07f97-a630-410b-88c8-ce71e4f9eb32] Going to try to terminate instance {{(pid=117879) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 10:31:53.807829 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-584f3915-1631-418b-a0a7-ea939977b210 tempest-VolumesNegativeTest-1214922722 tempest-VolumesNegativeTest-1214922722-project] 10.222.0.33 "DELETE /compute/v2.1/servers/afd07f97-a630-410b-88c8-ce71e4f9eb32" status: 204 len: 0 microversion: 2.1 time: 0.168587 Jul 18 10:31:53.811524 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 205/405] 10.222.0.33 () {58 vars in 1238 bytes} [Mon Jul 18 10:31:53 2022] DELETE /compute/v2.1/servers/afd07f97-a630-410b-88c8-ce71e4f9eb32 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 18 10:31:53.820984 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-97878283-8f9e-4fdb-b8b0-5a9abe3912e5 tempest-VolumesNegativeTest-1214922722 tempest-VolumesNegativeTest-1214922722-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:31:53.821683 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-97878283-8f9e-4fdb-b8b0-5a9abe3912e5 tempest-VolumesNegativeTest-1214922722 tempest-VolumesNegativeTest-1214922722-project] [instance: afd07f97-a630-410b-88c8-ce71e4f9eb32] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:31:53.827796 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-97878283-8f9e-4fdb-b8b0-5a9abe3912e5 tempest-VolumesNegativeTest-1214922722 tempest-VolumesNegativeTest-1214922722-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:31:53.828251 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-97878283-8f9e-4fdb-b8b0-5a9abe3912e5 tempest-VolumesNegativeTest-1214922722 tempest-VolumesNegativeTest-1214922722-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:31:53.829595 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-97878283-8f9e-4fdb-b8b0-5a9abe3912e5 tempest-VolumesNegativeTest-1214922722 tempest-VolumesNegativeTest-1214922722-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:31:53.830023 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-97878283-8f9e-4fdb-b8b0-5a9abe3912e5 tempest-VolumesNegativeTest-1214922722 tempest-VolumesNegativeTest-1214922722-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:31:53.961025 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-5eb29396-1b9f-4b09-96d4-6baa9b4b1237 tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c9439cb644548b8b3b5fd5c610757b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6203312784435b8cd1fdfede3fb597', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:31:53.968448 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-5eb29396-1b9f-4b09-96d4-6baa9b4b1237 tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] 10.222.0.33 "GET /compute/v2.1/servers/a6d1079b-c5d3-4062-9759-b681711cef09" status: 200 len: 1319 microversion: 2.1 time: 0.316422 Jul 18 10:31:53.969126 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 201/406] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:31:53 2022] GET /compute/v2.1/servers/a6d1079b-c5d3-4062-9759-b681711cef09 => generated 1319 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:31:54.006844 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-97878283-8f9e-4fdb-b8b0-5a9abe3912e5 tempest-VolumesNegativeTest-1214922722 tempest-VolumesNegativeTest-1214922722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a5ceff981447c4a65c0f2cec7607a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd9fedf211d41878c431ee91f87aaf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:31:54.010363 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG dbcounter [-] [117879] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:31:54.015324 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-97878283-8f9e-4fdb-b8b0-5a9abe3912e5 tempest-VolumesNegativeTest-1214922722 tempest-VolumesNegativeTest-1214922722-project] 10.222.0.33 "GET /compute/v2.1/servers/afd07f97-a630-410b-88c8-ce71e4f9eb32" status: 200 len: 1471 microversion: 2.1 time: 0.198807 Jul 18 10:31:54.015882 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 206/407] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:31:53 2022] GET /compute/v2.1/servers/afd07f97-a630-410b-88c8-ce71e4f9eb32 => generated 1471 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:31:54.540262 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-c254d3a8-1baf-4765-bad0-bffc1d78c471 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:31:54.540835 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-c254d3a8-1baf-4765-bad0-bffc1d78c471 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] [instance: 83b29c39-45ca-4cb3-ad7d-f7bd47bfe667] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:31:54.547256 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-c254d3a8-1baf-4765-bad0-bffc1d78c471 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:31:54.547694 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-c254d3a8-1baf-4765-bad0-bffc1d78c471 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:31:54.548448 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-c254d3a8-1baf-4765-bad0-bffc1d78c471 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:31:54.548913 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-c254d3a8-1baf-4765-bad0-bffc1d78c471 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:31:54.610701 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-c254d3a8-1baf-4765-bad0-bffc1d78c471 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af30265de71409d876112350949a2a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f62ef510c8484995a2f31f29104f399f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:31:54.618122 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-c254d3a8-1baf-4765-bad0-bffc1d78c471 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] 10.222.0.33 "GET /compute/v2.1/servers/83b29c39-45ca-4cb3-ad7d-f7bd47bfe667" status: 200 len: 1317 microversion: 2.1 time: 0.081745 Jul 18 10:31:54.618685 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 202/408] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:31:54 2022] GET /compute/v2.1/servers/83b29c39-45ca-4cb3-ad7d-f7bd47bfe667 => generated 1317 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:31:54.985869 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-fccf9a5b-3c56-4326-a332-b22289dbeb2a tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:31:54.986469 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-fccf9a5b-3c56-4326-a332-b22289dbeb2a tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] [instance: a6d1079b-c5d3-4062-9759-b681711cef09] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:31:54.994244 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-fccf9a5b-3c56-4326-a332-b22289dbeb2a tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:31:54.994689 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-fccf9a5b-3c56-4326-a332-b22289dbeb2a tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:31:54.995458 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-fccf9a5b-3c56-4326-a332-b22289dbeb2a tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:31:54.995899 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-fccf9a5b-3c56-4326-a332-b22289dbeb2a tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:31:55.032760 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-484860ca-e4c9-424b-a24e-da0d825bcd71 tempest-VolumesNegativeTest-1214922722 tempest-VolumesNegativeTest-1214922722-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:31:55.033366 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-484860ca-e4c9-424b-a24e-da0d825bcd71 tempest-VolumesNegativeTest-1214922722 tempest-VolumesNegativeTest-1214922722-project] [instance: afd07f97-a630-410b-88c8-ce71e4f9eb32] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:31:55.039491 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-484860ca-e4c9-424b-a24e-da0d825bcd71 tempest-VolumesNegativeTest-1214922722 tempest-VolumesNegativeTest-1214922722-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:31:55.039940 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-484860ca-e4c9-424b-a24e-da0d825bcd71 tempest-VolumesNegativeTest-1214922722 tempest-VolumesNegativeTest-1214922722-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:31:55.040735 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-484860ca-e4c9-424b-a24e-da0d825bcd71 tempest-VolumesNegativeTest-1214922722 tempest-VolumesNegativeTest-1214922722-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:31:55.041162 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-484860ca-e4c9-424b-a24e-da0d825bcd71 tempest-VolumesNegativeTest-1214922722 tempest-VolumesNegativeTest-1214922722-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:31:55.222923 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-fccf9a5b-3c56-4326-a332-b22289dbeb2a tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c9439cb644548b8b3b5fd5c610757b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6203312784435b8cd1fdfede3fb597', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:31:55.230712 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-fccf9a5b-3c56-4326-a332-b22289dbeb2a tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] 10.222.0.33 "GET /compute/v2.1/servers/a6d1079b-c5d3-4062-9759-b681711cef09" status: 200 len: 1319 microversion: 2.1 time: 0.248717 Jul 18 10:31:55.231401 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 207/409] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:31:54 2022] GET /compute/v2.1/servers/a6d1079b-c5d3-4062-9759-b681711cef09 => generated 1319 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:31:55.301254 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-484860ca-e4c9-424b-a24e-da0d825bcd71 tempest-VolumesNegativeTest-1214922722 tempest-VolumesNegativeTest-1214922722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a5ceff981447c4a65c0f2cec7607a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd9fedf211d41878c431ee91f87aaf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:31:55.308660 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-484860ca-e4c9-424b-a24e-da0d825bcd71 tempest-VolumesNegativeTest-1214922722 tempest-VolumesNegativeTest-1214922722-project] 10.222.0.33 "GET /compute/v2.1/servers/afd07f97-a630-410b-88c8-ce71e4f9eb32" status: 200 len: 1471 microversion: 2.1 time: 0.280161 Jul 18 10:31:55.309215 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 203/410] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:31:55 2022] GET /compute/v2.1/servers/afd07f97-a630-410b-88c8-ce71e4f9eb32 => generated 1471 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:31:55.636266 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-1ca45807-048f-4d9a-9002-787e889f2ed0 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:31:55.637780 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-1ca45807-048f-4d9a-9002-787e889f2ed0 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] [instance: 83b29c39-45ca-4cb3-ad7d-f7bd47bfe667] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:31:55.646549 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-1ca45807-048f-4d9a-9002-787e889f2ed0 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:31:55.649129 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-1ca45807-048f-4d9a-9002-787e889f2ed0 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:31:55.650891 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-1ca45807-048f-4d9a-9002-787e889f2ed0 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:31:55.657597 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-1ca45807-048f-4d9a-9002-787e889f2ed0 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:31:55.784602 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-1ca45807-048f-4d9a-9002-787e889f2ed0 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af30265de71409d876112350949a2a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f62ef510c8484995a2f31f29104f399f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:31:55.793707 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-1ca45807-048f-4d9a-9002-787e889f2ed0 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] 10.222.0.33 "GET /compute/v2.1/servers/83b29c39-45ca-4cb3-ad7d-f7bd47bfe667" status: 200 len: 1317 microversion: 2.1 time: 0.162300 Jul 18 10:31:55.805262 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 208/411] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:31:55 2022] GET /compute/v2.1/servers/83b29c39-45ca-4cb3-ad7d-f7bd47bfe667 => generated 1317 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:31:56.247791 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-6e6845e1-6ff7-4193-9caf-8e2e117c6726 tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:31:56.248402 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-6e6845e1-6ff7-4193-9caf-8e2e117c6726 tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] [instance: a6d1079b-c5d3-4062-9759-b681711cef09] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:31:56.255605 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-6e6845e1-6ff7-4193-9caf-8e2e117c6726 tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:31:56.256133 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-6e6845e1-6ff7-4193-9caf-8e2e117c6726 tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:31:56.257021 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-6e6845e1-6ff7-4193-9caf-8e2e117c6726 tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:31:56.257419 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-6e6845e1-6ff7-4193-9caf-8e2e117c6726 tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:31:56.325859 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-ab1b6ec6-c242-4362-9df3-8a469c5ddd1d tempest-VolumesNegativeTest-1214922722 tempest-VolumesNegativeTest-1214922722-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:31:56.327238 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-ab1b6ec6-c242-4362-9df3-8a469c5ddd1d tempest-VolumesNegativeTest-1214922722 tempest-VolumesNegativeTest-1214922722-project] [instance: afd07f97-a630-410b-88c8-ce71e4f9eb32] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:31:56.335020 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-ab1b6ec6-c242-4362-9df3-8a469c5ddd1d tempest-VolumesNegativeTest-1214922722 tempest-VolumesNegativeTest-1214922722-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:31:56.335466 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-ab1b6ec6-c242-4362-9df3-8a469c5ddd1d tempest-VolumesNegativeTest-1214922722 tempest-VolumesNegativeTest-1214922722-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:31:56.336433 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-ab1b6ec6-c242-4362-9df3-8a469c5ddd1d tempest-VolumesNegativeTest-1214922722 tempest-VolumesNegativeTest-1214922722-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:31:56.337187 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-ab1b6ec6-c242-4362-9df3-8a469c5ddd1d tempest-VolumesNegativeTest-1214922722 tempest-VolumesNegativeTest-1214922722-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:31:56.421116 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-6e6845e1-6ff7-4193-9caf-8e2e117c6726 tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c9439cb644548b8b3b5fd5c610757b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6203312784435b8cd1fdfede3fb597', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:31:56.430302 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-6e6845e1-6ff7-4193-9caf-8e2e117c6726 tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] 10.222.0.33 "GET /compute/v2.1/servers/a6d1079b-c5d3-4062-9759-b681711cef09" status: 200 len: 1319 microversion: 2.1 time: 0.186294 Jul 18 10:31:56.431571 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 204/412] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:31:56 2022] GET /compute/v2.1/servers/a6d1079b-c5d3-4062-9759-b681711cef09 => generated 1319 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:31:56.509581 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-ab1b6ec6-c242-4362-9df3-8a469c5ddd1d tempest-VolumesNegativeTest-1214922722 tempest-VolumesNegativeTest-1214922722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a5ceff981447c4a65c0f2cec7607a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd9fedf211d41878c431ee91f87aaf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:31:56.517119 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-ab1b6ec6-c242-4362-9df3-8a469c5ddd1d tempest-VolumesNegativeTest-1214922722 tempest-VolumesNegativeTest-1214922722-project] 10.222.0.33 "GET /compute/v2.1/servers/afd07f97-a630-410b-88c8-ce71e4f9eb32" status: 200 len: 1471 microversion: 2.1 time: 0.195677 Jul 18 10:31:56.517683 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 209/413] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:31:56 2022] GET /compute/v2.1/servers/afd07f97-a630-410b-88c8-ce71e4f9eb32 => generated 1471 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:31:56.811190 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-0bacd78c-11e7-4e72-aa88-9a224c3019b5 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:31:56.811798 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-0bacd78c-11e7-4e72-aa88-9a224c3019b5 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] [instance: 83b29c39-45ca-4cb3-ad7d-f7bd47bfe667] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:31:56.817999 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-0bacd78c-11e7-4e72-aa88-9a224c3019b5 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:31:56.818444 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-0bacd78c-11e7-4e72-aa88-9a224c3019b5 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:31:56.819216 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-0bacd78c-11e7-4e72-aa88-9a224c3019b5 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:31:56.819648 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-0bacd78c-11e7-4e72-aa88-9a224c3019b5 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:31:56.960739 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-0bacd78c-11e7-4e72-aa88-9a224c3019b5 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af30265de71409d876112350949a2a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f62ef510c8484995a2f31f29104f399f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:31:56.968389 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-0bacd78c-11e7-4e72-aa88-9a224c3019b5 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] 10.222.0.33 "GET /compute/v2.1/servers/83b29c39-45ca-4cb3-ad7d-f7bd47bfe667" status: 200 len: 1359 microversion: 2.1 time: 0.161050 Jul 18 10:31:56.969628 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 205/414] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:31:56 2022] GET /compute/v2.1/servers/83b29c39-45ca-4cb3-ad7d-f7bd47bfe667 => generated 1359 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:31:57.448477 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-b357f633-3458-4756-ae78-1ffa7e18fbd6 tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:31:57.449263 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-b357f633-3458-4756-ae78-1ffa7e18fbd6 tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] [instance: a6d1079b-c5d3-4062-9759-b681711cef09] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:31:57.456285 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-b357f633-3458-4756-ae78-1ffa7e18fbd6 tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:31:57.456769 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-b357f633-3458-4756-ae78-1ffa7e18fbd6 tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:31:57.457668 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-b357f633-3458-4756-ae78-1ffa7e18fbd6 tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:31:57.458142 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-b357f633-3458-4756-ae78-1ffa7e18fbd6 tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:31:57.534758 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-31b93dc9-e05a-4f65-b496-384bf976e16a tempest-VolumesNegativeTest-1214922722 tempest-VolumesNegativeTest-1214922722-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:31:57.535362 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-31b93dc9-e05a-4f65-b496-384bf976e16a tempest-VolumesNegativeTest-1214922722 tempest-VolumesNegativeTest-1214922722-project] [instance: afd07f97-a630-410b-88c8-ce71e4f9eb32] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:31:57.542167 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-31b93dc9-e05a-4f65-b496-384bf976e16a tempest-VolumesNegativeTest-1214922722 tempest-VolumesNegativeTest-1214922722-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:31:57.542807 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-31b93dc9-e05a-4f65-b496-384bf976e16a tempest-VolumesNegativeTest-1214922722 tempest-VolumesNegativeTest-1214922722-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:31:57.544213 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-31b93dc9-e05a-4f65-b496-384bf976e16a tempest-VolumesNegativeTest-1214922722 tempest-VolumesNegativeTest-1214922722-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:31:57.545146 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-31b93dc9-e05a-4f65-b496-384bf976e16a tempest-VolumesNegativeTest-1214922722 tempest-VolumesNegativeTest-1214922722-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:31:57.635611 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-b357f633-3458-4756-ae78-1ffa7e18fbd6 tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c9439cb644548b8b3b5fd5c610757b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6203312784435b8cd1fdfede3fb597', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:31:57.644272 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-b357f633-3458-4756-ae78-1ffa7e18fbd6 tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] 10.222.0.33 "GET /compute/v2.1/servers/a6d1079b-c5d3-4062-9759-b681711cef09" status: 200 len: 1319 microversion: 2.1 time: 0.199799 Jul 18 10:31:57.653623 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 210/415] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:31:57 2022] GET /compute/v2.1/servers/a6d1079b-c5d3-4062-9759-b681711cef09 => generated 1319 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:31:57.705033 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-31b93dc9-e05a-4f65-b496-384bf976e16a tempest-VolumesNegativeTest-1214922722 tempest-VolumesNegativeTest-1214922722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a5ceff981447c4a65c0f2cec7607a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd9fedf211d41878c431ee91f87aaf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:31:57.712605 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-31b93dc9-e05a-4f65-b496-384bf976e16a tempest-VolumesNegativeTest-1214922722 tempest-VolumesNegativeTest-1214922722-project] 10.222.0.33 "GET /compute/v2.1/servers/afd07f97-a630-410b-88c8-ce71e4f9eb32" status: 200 len: 1471 microversion: 2.1 time: 0.182145 Jul 18 10:31:57.713167 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 206/416] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:31:57 2022] GET /compute/v2.1/servers/afd07f97-a630-410b-88c8-ce71e4f9eb32 => generated 1471 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:31:57.985646 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-afb3acce-34c4-4054-9c18-361a70ef167e tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:31:57.986256 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-afb3acce-34c4-4054-9c18-361a70ef167e tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] [instance: 83b29c39-45ca-4cb3-ad7d-f7bd47bfe667] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:31:57.994929 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-afb3acce-34c4-4054-9c18-361a70ef167e tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:31:57.994929 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-afb3acce-34c4-4054-9c18-361a70ef167e tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:31:57.994929 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-afb3acce-34c4-4054-9c18-361a70ef167e tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:31:57.994929 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-afb3acce-34c4-4054-9c18-361a70ef167e tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:31:58.025530 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [req-7a7cefb2-ba7a-4dec-8ce7-a7a42363e0b6 req-174aefcb-9b0f-4004-b3c9-1909a5646e64 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "afd07f97-a630-410b-88c8-ce71e4f9eb32", "name": "network-vif-unplugged", "status": "completed", "tag": "8a18070f-25e3-4429-b290-643f2e4e970a"}]} {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:31:58.036156 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [req-7a7cefb2-ba7a-4dec-8ce7-a7a42363e0b6 req-174aefcb-9b0f-4004-b3c9-1909a5646e64 service nova] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:31:58.036972 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [req-7a7cefb2-ba7a-4dec-8ce7-a7a42363e0b6 req-174aefcb-9b0f-4004-b3c9-1909a5646e64 service nova] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:31:58.049562 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.compute.server_external_events [req-7a7cefb2-ba7a-4dec-8ce7-a7a42363e0b6 req-174aefcb-9b0f-4004-b3c9-1909a5646e64 service nova] Creating event network-vif-unplugged:8a18070f-25e3-4429-b290-643f2e4e970a for instance afd07f97-a630-410b-88c8-ce71e4f9eb32 on hv-cinder-83754 Jul 18 10:31:58.057267 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [req-7a7cefb2-ba7a-4dec-8ce7-a7a42363e0b6 req-174aefcb-9b0f-4004-b3c9-1909a5646e64 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033763 Jul 18 10:31:58.058480 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 207/417] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jul 18 10:31:58 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:31:58.149527 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-afb3acce-34c4-4054-9c18-361a70ef167e tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af30265de71409d876112350949a2a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f62ef510c8484995a2f31f29104f399f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:31:58.165105 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-afb3acce-34c4-4054-9c18-361a70ef167e tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] 10.222.0.33 "GET /compute/v2.1/servers/83b29c39-45ca-4cb3-ad7d-f7bd47bfe667" status: 200 len: 1359 microversion: 2.1 time: 0.183113 Jul 18 10:31:58.166009 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 211/418] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:31:57 2022] GET /compute/v2.1/servers/83b29c39-45ca-4cb3-ad7d-f7bd47bfe667 => generated 1359 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:31:58.658132 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG dbcounter [-] [117880] Writing DB stats nova_cell0:SELECT=2 {{(pid=117880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:31:58.663054 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-0e3babb6-8f6c-492f-8c7b-b6907f2725f1 tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:31:58.663794 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-0e3babb6-8f6c-492f-8c7b-b6907f2725f1 tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] [instance: a6d1079b-c5d3-4062-9759-b681711cef09] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:31:58.670840 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-0e3babb6-8f6c-492f-8c7b-b6907f2725f1 tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:31:58.671288 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-0e3babb6-8f6c-492f-8c7b-b6907f2725f1 tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:31:58.672593 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-0e3babb6-8f6c-492f-8c7b-b6907f2725f1 tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:31:58.673029 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-0e3babb6-8f6c-492f-8c7b-b6907f2725f1 tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:31:58.735317 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-3d5f7964-1eb1-4418-8d06-417da2979046 tempest-VolumesNegativeTest-1214922722 tempest-VolumesNegativeTest-1214922722-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:31:58.735906 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-3d5f7964-1eb1-4418-8d06-417da2979046 tempest-VolumesNegativeTest-1214922722 tempest-VolumesNegativeTest-1214922722-project] [instance: afd07f97-a630-410b-88c8-ce71e4f9eb32] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:31:58.742783 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-3d5f7964-1eb1-4418-8d06-417da2979046 tempest-VolumesNegativeTest-1214922722 tempest-VolumesNegativeTest-1214922722-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:31:58.743252 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-3d5f7964-1eb1-4418-8d06-417da2979046 tempest-VolumesNegativeTest-1214922722 tempest-VolumesNegativeTest-1214922722-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:31:58.744014 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-3d5f7964-1eb1-4418-8d06-417da2979046 tempest-VolumesNegativeTest-1214922722 tempest-VolumesNegativeTest-1214922722-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:31:58.744453 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-3d5f7964-1eb1-4418-8d06-417da2979046 tempest-VolumesNegativeTest-1214922722 tempest-VolumesNegativeTest-1214922722-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:31:58.891765 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-0e3babb6-8f6c-492f-8c7b-b6907f2725f1 tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c9439cb644548b8b3b5fd5c610757b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6203312784435b8cd1fdfede3fb597', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:31:58.896698 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG dbcounter [-] [117880] Writing DB stats nova_cell1:SELECT=100 {{(pid=117880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:31:58.904676 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-0e3babb6-8f6c-492f-8c7b-b6907f2725f1 tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] 10.222.0.33 "GET /compute/v2.1/servers/a6d1079b-c5d3-4062-9759-b681711cef09" status: 200 len: 1319 microversion: 2.1 time: 0.246780 Jul 18 10:31:58.905636 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 208/419] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:31:58 2022] GET /compute/v2.1/servers/a6d1079b-c5d3-4062-9759-b681711cef09 => generated 1319 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:31:58.922789 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-3d5f7964-1eb1-4418-8d06-417da2979046 tempest-VolumesNegativeTest-1214922722 tempest-VolumesNegativeTest-1214922722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a5ceff981447c4a65c0f2cec7607a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd9fedf211d41878c431ee91f87aaf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:31:58.930654 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-3d5f7964-1eb1-4418-8d06-417da2979046 tempest-VolumesNegativeTest-1214922722 tempest-VolumesNegativeTest-1214922722-project] 10.222.0.33 "GET /compute/v2.1/servers/afd07f97-a630-410b-88c8-ce71e4f9eb32" status: 200 len: 1471 microversion: 2.1 time: 0.199711 Jul 18 10:31:58.931238 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 212/420] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:31:58 2022] GET /compute/v2.1/servers/afd07f97-a630-410b-88c8-ce71e4f9eb32 => generated 1471 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:31:59.183943 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-631cad39-a926-4774-9509-4d1b7ff5bcae tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:31:59.184969 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-631cad39-a926-4774-9509-4d1b7ff5bcae tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] [instance: 83b29c39-45ca-4cb3-ad7d-f7bd47bfe667] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:31:59.193336 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-631cad39-a926-4774-9509-4d1b7ff5bcae tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:31:59.193954 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-631cad39-a926-4774-9509-4d1b7ff5bcae tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:31:59.194848 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-631cad39-a926-4774-9509-4d1b7ff5bcae tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:31:59.195309 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-631cad39-a926-4774-9509-4d1b7ff5bcae tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:31:59.335617 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-631cad39-a926-4774-9509-4d1b7ff5bcae tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af30265de71409d876112350949a2a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f62ef510c8484995a2f31f29104f399f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:31:59.343374 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-631cad39-a926-4774-9509-4d1b7ff5bcae tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] 10.222.0.33 "GET /compute/v2.1/servers/83b29c39-45ca-4cb3-ad7d-f7bd47bfe667" status: 200 len: 1359 microversion: 2.1 time: 0.163341 Jul 18 10:31:59.344859 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 209/421] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:31:59 2022] GET /compute/v2.1/servers/83b29c39-45ca-4cb3-ad7d-f7bd47bfe667 => generated 1359 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:31:59.922380 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-7bed7c83-3cab-4e6c-808f-bffbbd831f9e tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:31:59.923665 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-7bed7c83-3cab-4e6c-808f-bffbbd831f9e tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] [instance: a6d1079b-c5d3-4062-9759-b681711cef09] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:31:59.930339 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-7bed7c83-3cab-4e6c-808f-bffbbd831f9e tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:31:59.931108 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-7bed7c83-3cab-4e6c-808f-bffbbd831f9e tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:31:59.932140 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-7bed7c83-3cab-4e6c-808f-bffbbd831f9e tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:31:59.932818 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-7bed7c83-3cab-4e6c-808f-bffbbd831f9e tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:31:59.947279 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-2695b59a-ed3f-44a1-b6b5-5f15dce39ef1 tempest-VolumesNegativeTest-1214922722 tempest-VolumesNegativeTest-1214922722-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:31:59.947851 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-2695b59a-ed3f-44a1-b6b5-5f15dce39ef1 tempest-VolumesNegativeTest-1214922722 tempest-VolumesNegativeTest-1214922722-project] [instance: afd07f97-a630-410b-88c8-ce71e4f9eb32] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:31:59.950102 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG dbcounter [-] [117880] Writing DB stats nova_cell0:SELECT=10 {{(pid=117880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:31:59.955467 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-2695b59a-ed3f-44a1-b6b5-5f15dce39ef1 tempest-VolumesNegativeTest-1214922722 tempest-VolumesNegativeTest-1214922722-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:31:59.955885 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-2695b59a-ed3f-44a1-b6b5-5f15dce39ef1 tempest-VolumesNegativeTest-1214922722 tempest-VolumesNegativeTest-1214922722-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:31:59.956669 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-2695b59a-ed3f-44a1-b6b5-5f15dce39ef1 tempest-VolumesNegativeTest-1214922722 tempest-VolumesNegativeTest-1214922722-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:31:59.957097 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-2695b59a-ed3f-44a1-b6b5-5f15dce39ef1 tempest-VolumesNegativeTest-1214922722 tempest-VolumesNegativeTest-1214922722-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:32:00.148024 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-7bed7c83-3cab-4e6c-808f-bffbbd831f9e tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c9439cb644548b8b3b5fd5c610757b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6203312784435b8cd1fdfede3fb597', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:32:00.155688 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-2695b59a-ed3f-44a1-b6b5-5f15dce39ef1 tempest-VolumesNegativeTest-1214922722 tempest-VolumesNegativeTest-1214922722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a5ceff981447c4a65c0f2cec7607a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd9fedf211d41878c431ee91f87aaf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:32:00.160658 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-7bed7c83-3cab-4e6c-808f-bffbbd831f9e tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] 10.222.0.33 "GET /compute/v2.1/servers/a6d1079b-c5d3-4062-9759-b681711cef09" status: 200 len: 1319 microversion: 2.1 time: 0.242554 Jul 18 10:32:00.161241 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 213/422] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:31:59 2022] GET /compute/v2.1/servers/a6d1079b-c5d3-4062-9759-b681711cef09 => generated 1319 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:32:00.164216 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-2695b59a-ed3f-44a1-b6b5-5f15dce39ef1 tempest-VolumesNegativeTest-1214922722 tempest-VolumesNegativeTest-1214922722-project] 10.222.0.33 "GET /compute/v2.1/servers/afd07f97-a630-410b-88c8-ce71e4f9eb32" status: 200 len: 1471 microversion: 2.1 time: 0.220768 Jul 18 10:32:00.164907 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 210/423] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:31:59 2022] GET /compute/v2.1/servers/afd07f97-a630-410b-88c8-ce71e4f9eb32 => generated 1471 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:32:00.362991 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-b458c8b4-4929-4bff-a5d5-5f0cfba94f53 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:32:00.363515 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-b458c8b4-4929-4bff-a5d5-5f0cfba94f53 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] [instance: 83b29c39-45ca-4cb3-ad7d-f7bd47bfe667] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:32:00.369585 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-b458c8b4-4929-4bff-a5d5-5f0cfba94f53 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:32:00.370038 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-b458c8b4-4929-4bff-a5d5-5f0cfba94f53 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:32:00.370813 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-b458c8b4-4929-4bff-a5d5-5f0cfba94f53 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:32:00.371252 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-b458c8b4-4929-4bff-a5d5-5f0cfba94f53 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:32:00.508420 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-b458c8b4-4929-4bff-a5d5-5f0cfba94f53 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af30265de71409d876112350949a2a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f62ef510c8484995a2f31f29104f399f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:32:00.517332 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-b458c8b4-4929-4bff-a5d5-5f0cfba94f53 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] 10.222.0.33 "GET /compute/v2.1/servers/83b29c39-45ca-4cb3-ad7d-f7bd47bfe667" status: 200 len: 1359 microversion: 2.1 time: 0.158944 Jul 18 10:32:00.518086 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 214/424] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:32:00 2022] GET /compute/v2.1/servers/83b29c39-45ca-4cb3-ad7d-f7bd47bfe667 => generated 1359 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:32:01.181469 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-da9e54bd-b7b2-45f2-aeb4-bd4b959baa65 tempest-VolumesNegativeTest-1214922722 tempest-VolumesNegativeTest-1214922722-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:32:01.182179 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-da9e54bd-b7b2-45f2-aeb4-bd4b959baa65 tempest-VolumesNegativeTest-1214922722 tempest-VolumesNegativeTest-1214922722-project] [instance: afd07f97-a630-410b-88c8-ce71e4f9eb32] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:32:01.185968 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-7ecddda8-a962-49c6-8d89-34318d4d0a13 tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:32:01.186775 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-7ecddda8-a962-49c6-8d89-34318d4d0a13 tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] [instance: a6d1079b-c5d3-4062-9759-b681711cef09] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:32:01.190980 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG dbcounter [-] [117879] Writing DB stats nova_cell0:SELECT=2 {{(pid=117879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:32:01.197057 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-da9e54bd-b7b2-45f2-aeb4-bd4b959baa65 tempest-VolumesNegativeTest-1214922722 tempest-VolumesNegativeTest-1214922722-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:32:01.197512 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-da9e54bd-b7b2-45f2-aeb4-bd4b959baa65 tempest-VolumesNegativeTest-1214922722 tempest-VolumesNegativeTest-1214922722-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:32:01.198287 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-da9e54bd-b7b2-45f2-aeb4-bd4b959baa65 tempest-VolumesNegativeTest-1214922722 tempest-VolumesNegativeTest-1214922722-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:32:01.198752 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-da9e54bd-b7b2-45f2-aeb4-bd4b959baa65 tempest-VolumesNegativeTest-1214922722 tempest-VolumesNegativeTest-1214922722-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:32:01.207116 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-7ecddda8-a962-49c6-8d89-34318d4d0a13 tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:32:01.207821 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-7ecddda8-a962-49c6-8d89-34318d4d0a13 tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:32:01.208780 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-7ecddda8-a962-49c6-8d89-34318d4d0a13 tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:32:01.209393 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-7ecddda8-a962-49c6-8d89-34318d4d0a13 tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:32:01.297327 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG dbcounter [-] [117879] Writing DB stats nova_cell0:SELECT=10 {{(pid=117879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:32:01.420872 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-da9e54bd-b7b2-45f2-aeb4-bd4b959baa65 tempest-VolumesNegativeTest-1214922722 tempest-VolumesNegativeTest-1214922722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a5ceff981447c4a65c0f2cec7607a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd9fedf211d41878c431ee91f87aaf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:32:01.428689 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-7ecddda8-a962-49c6-8d89-34318d4d0a13 tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c9439cb644548b8b3b5fd5c610757b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6203312784435b8cd1fdfede3fb597', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:32:01.429652 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-da9e54bd-b7b2-45f2-aeb4-bd4b959baa65 tempest-VolumesNegativeTest-1214922722 tempest-VolumesNegativeTest-1214922722-project] 10.222.0.33 "GET /compute/v2.1/servers/afd07f97-a630-410b-88c8-ce71e4f9eb32" status: 200 len: 1471 microversion: 2.1 time: 0.251817 Jul 18 10:32:01.430425 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 215/425] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:32:01 2022] GET /compute/v2.1/servers/afd07f97-a630-410b-88c8-ce71e4f9eb32 => generated 1471 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:32:01.442651 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-7ecddda8-a962-49c6-8d89-34318d4d0a13 tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] 10.222.0.33 "GET /compute/v2.1/servers/a6d1079b-c5d3-4062-9759-b681711cef09" status: 200 len: 1319 microversion: 2.1 time: 0.268576 Jul 18 10:32:01.443496 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 211/426] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:32:01 2022] GET /compute/v2.1/servers/a6d1079b-c5d3-4062-9759-b681711cef09 => generated 1319 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:32:01.533501 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-ac802ff1-8b3a-49ae-ad71-55c674a16b03 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:32:01.534433 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-ac802ff1-8b3a-49ae-ad71-55c674a16b03 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] [instance: 83b29c39-45ca-4cb3-ad7d-f7bd47bfe667] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:32:01.541033 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-ac802ff1-8b3a-49ae-ad71-55c674a16b03 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:32:01.541563 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-ac802ff1-8b3a-49ae-ad71-55c674a16b03 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:32:01.542279 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-ac802ff1-8b3a-49ae-ad71-55c674a16b03 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:32:01.542754 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-ac802ff1-8b3a-49ae-ad71-55c674a16b03 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:32:01.689173 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-ac802ff1-8b3a-49ae-ad71-55c674a16b03 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af30265de71409d876112350949a2a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f62ef510c8484995a2f31f29104f399f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:32:01.697837 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-ac802ff1-8b3a-49ae-ad71-55c674a16b03 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] 10.222.0.33 "GET /compute/v2.1/servers/83b29c39-45ca-4cb3-ad7d-f7bd47bfe667" status: 200 len: 1359 microversion: 2.1 time: 0.168125 Jul 18 10:32:01.698585 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 216/427] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:32:01 2022] GET /compute/v2.1/servers/83b29c39-45ca-4cb3-ad7d-f7bd47bfe667 => generated 1359 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:32:02.447422 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-47ca8b42-37da-4ffd-ba3c-fd04a4234a40 tempest-VolumesNegativeTest-1214922722 tempest-VolumesNegativeTest-1214922722-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:32:02.448069 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-47ca8b42-37da-4ffd-ba3c-fd04a4234a40 tempest-VolumesNegativeTest-1214922722 tempest-VolumesNegativeTest-1214922722-project] [instance: afd07f97-a630-410b-88c8-ce71e4f9eb32] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:32:02.454962 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-47ca8b42-37da-4ffd-ba3c-fd04a4234a40 tempest-VolumesNegativeTest-1214922722 tempest-VolumesNegativeTest-1214922722-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:32:02.455407 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-47ca8b42-37da-4ffd-ba3c-fd04a4234a40 tempest-VolumesNegativeTest-1214922722 tempest-VolumesNegativeTest-1214922722-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:32:02.456168 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-47ca8b42-37da-4ffd-ba3c-fd04a4234a40 tempest-VolumesNegativeTest-1214922722 tempest-VolumesNegativeTest-1214922722-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:32:02.456630 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-47ca8b42-37da-4ffd-ba3c-fd04a4234a40 tempest-VolumesNegativeTest-1214922722 tempest-VolumesNegativeTest-1214922722-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:32:02.459490 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-0068dfc5-50b3-4994-835c-3d840de6490f tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:32:02.460087 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-0068dfc5-50b3-4994-835c-3d840de6490f tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] [instance: a6d1079b-c5d3-4062-9759-b681711cef09] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:32:02.466515 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-0068dfc5-50b3-4994-835c-3d840de6490f tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:32:02.466966 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-0068dfc5-50b3-4994-835c-3d840de6490f tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:32:02.467719 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-0068dfc5-50b3-4994-835c-3d840de6490f tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:32:02.468150 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-0068dfc5-50b3-4994-835c-3d840de6490f tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:32:02.664205 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-47ca8b42-37da-4ffd-ba3c-fd04a4234a40 tempest-VolumesNegativeTest-1214922722 tempest-VolumesNegativeTest-1214922722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a5ceff981447c4a65c0f2cec7607a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd9fedf211d41878c431ee91f87aaf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:32:02.672662 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-47ca8b42-37da-4ffd-ba3c-fd04a4234a40 tempest-VolumesNegativeTest-1214922722 tempest-VolumesNegativeTest-1214922722-project] 10.222.0.33 "GET /compute/v2.1/servers/afd07f97-a630-410b-88c8-ce71e4f9eb32" status: 200 len: 1471 microversion: 2.1 time: 0.229009 Jul 18 10:32:02.677327 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-0068dfc5-50b3-4994-835c-3d840de6490f tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c9439cb644548b8b3b5fd5c610757b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6203312784435b8cd1fdfede3fb597', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:32:02.682734 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 212/428] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:32:02 2022] GET /compute/v2.1/servers/afd07f97-a630-410b-88c8-ce71e4f9eb32 => generated 1471 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:32:02.685723 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-0068dfc5-50b3-4994-835c-3d840de6490f tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] 10.222.0.33 "GET /compute/v2.1/servers/a6d1079b-c5d3-4062-9759-b681711cef09" status: 200 len: 1319 microversion: 2.1 time: 0.229819 Jul 18 10:32:02.686587 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 217/429] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:32:02 2022] GET /compute/v2.1/servers/a6d1079b-c5d3-4062-9759-b681711cef09 => generated 1319 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:32:02.716472 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-409d9e70-bde9-4c80-b822-4dfb691ea2e1 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:32:02.717129 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-409d9e70-bde9-4c80-b822-4dfb691ea2e1 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] [instance: 83b29c39-45ca-4cb3-ad7d-f7bd47bfe667] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:32:02.725343 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-409d9e70-bde9-4c80-b822-4dfb691ea2e1 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:32:02.725747 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-409d9e70-bde9-4c80-b822-4dfb691ea2e1 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:32:02.727068 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-409d9e70-bde9-4c80-b822-4dfb691ea2e1 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:32:02.727656 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-409d9e70-bde9-4c80-b822-4dfb691ea2e1 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:32:02.868001 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-409d9e70-bde9-4c80-b822-4dfb691ea2e1 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af30265de71409d876112350949a2a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f62ef510c8484995a2f31f29104f399f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:32:02.875698 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-409d9e70-bde9-4c80-b822-4dfb691ea2e1 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] 10.222.0.33 "GET /compute/v2.1/servers/83b29c39-45ca-4cb3-ad7d-f7bd47bfe667" status: 200 len: 1359 microversion: 2.1 time: 0.163404 Jul 18 10:32:02.876321 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 213/430] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:32:02 2022] GET /compute/v2.1/servers/83b29c39-45ca-4cb3-ad7d-f7bd47bfe667 => generated 1359 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:32:03.690376 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-8ab28083-1564-4124-a508-d83e60034f21 tempest-VolumesNegativeTest-1214922722 tempest-VolumesNegativeTest-1214922722-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:32:03.691128 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-8ab28083-1564-4124-a508-d83e60034f21 tempest-VolumesNegativeTest-1214922722 tempest-VolumesNegativeTest-1214922722-project] [instance: afd07f97-a630-410b-88c8-ce71e4f9eb32] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:32:03.698718 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-8ab28083-1564-4124-a508-d83e60034f21 tempest-VolumesNegativeTest-1214922722 tempest-VolumesNegativeTest-1214922722-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:32:03.699182 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-8ab28083-1564-4124-a508-d83e60034f21 tempest-VolumesNegativeTest-1214922722 tempest-VolumesNegativeTest-1214922722-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:32:03.699979 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-8ab28083-1564-4124-a508-d83e60034f21 tempest-VolumesNegativeTest-1214922722 tempest-VolumesNegativeTest-1214922722-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:32:03.700425 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-8ab28083-1564-4124-a508-d83e60034f21 tempest-VolumesNegativeTest-1214922722 tempest-VolumesNegativeTest-1214922722-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:32:03.703192 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-99eee566-5bcb-44d9-b754-3db58ef163df tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:32:03.703676 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-99eee566-5bcb-44d9-b754-3db58ef163df tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] [instance: a6d1079b-c5d3-4062-9759-b681711cef09] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:32:03.710631 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-99eee566-5bcb-44d9-b754-3db58ef163df tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:32:03.711086 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-99eee566-5bcb-44d9-b754-3db58ef163df tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:32:03.711863 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-99eee566-5bcb-44d9-b754-3db58ef163df tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:32:03.712298 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-99eee566-5bcb-44d9-b754-3db58ef163df tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:32:03.913710 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-8ab28083-1564-4124-a508-d83e60034f21 tempest-VolumesNegativeTest-1214922722 tempest-VolumesNegativeTest-1214922722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a5ceff981447c4a65c0f2cec7607a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd9fedf211d41878c431ee91f87aaf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:32:03.921853 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-8ab28083-1564-4124-a508-d83e60034f21 tempest-VolumesNegativeTest-1214922722 tempest-VolumesNegativeTest-1214922722-project] 10.222.0.33 "GET /compute/v2.1/servers/afd07f97-a630-410b-88c8-ce71e4f9eb32" status: 200 len: 1471 microversion: 2.1 time: 0.235889 Jul 18 10:32:03.922685 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 218/431] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:32:03 2022] GET /compute/v2.1/servers/afd07f97-a630-410b-88c8-ce71e4f9eb32 => generated 1471 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:32:03.927889 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-99eee566-5bcb-44d9-b754-3db58ef163df tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c9439cb644548b8b3b5fd5c610757b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6203312784435b8cd1fdfede3fb597', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:32:03.928580 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-1529e4ae-b9e6-4fd4-9028-45eb84110bdb tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:32:03.929214 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-1529e4ae-b9e6-4fd4-9028-45eb84110bdb tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] [instance: 83b29c39-45ca-4cb3-ad7d-f7bd47bfe667] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:32:03.935520 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-1529e4ae-b9e6-4fd4-9028-45eb84110bdb tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:32:03.935983 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-1529e4ae-b9e6-4fd4-9028-45eb84110bdb tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:32:03.936805 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-99eee566-5bcb-44d9-b754-3db58ef163df tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] 10.222.0.33 "GET /compute/v2.1/servers/a6d1079b-c5d3-4062-9759-b681711cef09" status: 200 len: 1319 microversion: 2.1 time: 0.237351 Jul 18 10:32:03.936947 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-1529e4ae-b9e6-4fd4-9028-45eb84110bdb tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:32:03.938114 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-1529e4ae-b9e6-4fd4-9028-45eb84110bdb tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:32:03.938775 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 214/432] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:32:03 2022] GET /compute/v2.1/servers/a6d1079b-c5d3-4062-9759-b681711cef09 => generated 1319 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:32:04.075403 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-1529e4ae-b9e6-4fd4-9028-45eb84110bdb tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af30265de71409d876112350949a2a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f62ef510c8484995a2f31f29104f399f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:32:04.083359 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-1529e4ae-b9e6-4fd4-9028-45eb84110bdb tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] 10.222.0.33 "GET /compute/v2.1/servers/83b29c39-45ca-4cb3-ad7d-f7bd47bfe667" status: 200 len: 1359 microversion: 2.1 time: 0.159936 Jul 18 10:32:04.083918 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 219/433] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:32:03 2022] GET /compute/v2.1/servers/83b29c39-45ca-4cb3-ad7d-f7bd47bfe667 => generated 1359 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:32:04.940222 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-36f2c7f7-57a1-4941-8e0f-4d65ea86fe43 tempest-VolumesNegativeTest-1214922722 tempest-VolumesNegativeTest-1214922722-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:32:04.940900 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-36f2c7f7-57a1-4941-8e0f-4d65ea86fe43 tempest-VolumesNegativeTest-1214922722 tempest-VolumesNegativeTest-1214922722-project] [instance: afd07f97-a630-410b-88c8-ce71e4f9eb32] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:32:04.943194 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG dbcounter [-] [117880] Writing DB stats nova_api:SELECT=89,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=117880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:32:04.948391 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-36f2c7f7-57a1-4941-8e0f-4d65ea86fe43 tempest-VolumesNegativeTest-1214922722 tempest-VolumesNegativeTest-1214922722-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:32:04.948866 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-36f2c7f7-57a1-4941-8e0f-4d65ea86fe43 tempest-VolumesNegativeTest-1214922722 tempest-VolumesNegativeTest-1214922722-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:32:04.949954 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-36f2c7f7-57a1-4941-8e0f-4d65ea86fe43 tempest-VolumesNegativeTest-1214922722 tempest-VolumesNegativeTest-1214922722-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:32:04.950384 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-36f2c7f7-57a1-4941-8e0f-4d65ea86fe43 tempest-VolumesNegativeTest-1214922722 tempest-VolumesNegativeTest-1214922722-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:32:04.954055 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-34b46548-b93e-4994-8011-0438768d2ba6 tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:32:04.954670 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-34b46548-b93e-4994-8011-0438768d2ba6 tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] [instance: a6d1079b-c5d3-4062-9759-b681711cef09] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:32:04.961143 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-34b46548-b93e-4994-8011-0438768d2ba6 tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:32:04.961595 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-34b46548-b93e-4994-8011-0438768d2ba6 tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:32:04.962362 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-34b46548-b93e-4994-8011-0438768d2ba6 tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:32:04.962801 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-34b46548-b93e-4994-8011-0438768d2ba6 tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:32:05.145428 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-36f2c7f7-57a1-4941-8e0f-4d65ea86fe43 tempest-VolumesNegativeTest-1214922722 tempest-VolumesNegativeTest-1214922722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a5ceff981447c4a65c0f2cec7607a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd9fedf211d41878c431ee91f87aaf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:32:05.148436 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-34b46548-b93e-4994-8011-0438768d2ba6 tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c9439cb644548b8b3b5fd5c610757b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6203312784435b8cd1fdfede3fb597', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:32:05.153223 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-36f2c7f7-57a1-4941-8e0f-4d65ea86fe43 tempest-VolumesNegativeTest-1214922722 tempest-VolumesNegativeTest-1214922722-project] 10.222.0.33 "GET /compute/v2.1/servers/afd07f97-a630-410b-88c8-ce71e4f9eb32" status: 200 len: 1471 microversion: 2.1 time: 0.216900 Jul 18 10:32:05.154210 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 215/434] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:32:04 2022] GET /compute/v2.1/servers/afd07f97-a630-410b-88c8-ce71e4f9eb32 => generated 1471 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:32:05.159212 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-2ee52be3-8651-4416-bd5c-97d2eb506a85 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:32:05.159813 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-34b46548-b93e-4994-8011-0438768d2ba6 tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] 10.222.0.33 "GET /compute/v2.1/servers/a6d1079b-c5d3-4062-9759-b681711cef09" status: 200 len: 1319 microversion: 2.1 time: 0.209429 Jul 18 10:32:05.159938 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-2ee52be3-8651-4416-bd5c-97d2eb506a85 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] [instance: 83b29c39-45ca-4cb3-ad7d-f7bd47bfe667] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:32:05.160620 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 220/435] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:32:04 2022] GET /compute/v2.1/servers/a6d1079b-c5d3-4062-9759-b681711cef09 => generated 1319 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:32:05.165663 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-2ee52be3-8651-4416-bd5c-97d2eb506a85 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:32:05.166107 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-2ee52be3-8651-4416-bd5c-97d2eb506a85 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:32:05.166867 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-2ee52be3-8651-4416-bd5c-97d2eb506a85 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:32:05.167295 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-2ee52be3-8651-4416-bd5c-97d2eb506a85 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:32:05.345023 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-2ee52be3-8651-4416-bd5c-97d2eb506a85 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af30265de71409d876112350949a2a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f62ef510c8484995a2f31f29104f399f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:32:05.353854 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-2ee52be3-8651-4416-bd5c-97d2eb506a85 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] 10.222.0.33 "GET /compute/v2.1/servers/83b29c39-45ca-4cb3-ad7d-f7bd47bfe667" status: 200 len: 1359 microversion: 2.1 time: 0.198621 Jul 18 10:32:05.354414 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 216/436] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:32:05 2022] GET /compute/v2.1/servers/83b29c39-45ca-4cb3-ad7d-f7bd47bfe667 => generated 1359 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:32:06.171657 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-a6d3afb2-a372-4302-b861-ef2a1e7661d6 tempest-VolumesNegativeTest-1214922722 tempest-VolumesNegativeTest-1214922722-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:32:06.172603 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-a6d3afb2-a372-4302-b861-ef2a1e7661d6 tempest-VolumesNegativeTest-1214922722 tempest-VolumesNegativeTest-1214922722-project] [instance: afd07f97-a630-410b-88c8-ce71e4f9eb32] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:32:06.177327 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-fa5287a7-df4c-4ffc-b5f8-4766f31a9546 tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:32:06.178557 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-fa5287a7-df4c-4ffc-b5f8-4766f31a9546 tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] [instance: a6d1079b-c5d3-4062-9759-b681711cef09] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:32:06.182232 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-a6d3afb2-a372-4302-b861-ef2a1e7661d6 tempest-VolumesNegativeTest-1214922722 tempest-VolumesNegativeTest-1214922722-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:32:06.182684 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-a6d3afb2-a372-4302-b861-ef2a1e7661d6 tempest-VolumesNegativeTest-1214922722 tempest-VolumesNegativeTest-1214922722-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:32:06.183452 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-a6d3afb2-a372-4302-b861-ef2a1e7661d6 tempest-VolumesNegativeTest-1214922722 tempest-VolumesNegativeTest-1214922722-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:32:06.184049 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-a6d3afb2-a372-4302-b861-ef2a1e7661d6 tempest-VolumesNegativeTest-1214922722 tempest-VolumesNegativeTest-1214922722-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:32:06.191234 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-fa5287a7-df4c-4ffc-b5f8-4766f31a9546 tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:32:06.192021 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-fa5287a7-df4c-4ffc-b5f8-4766f31a9546 tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:32:06.192952 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-fa5287a7-df4c-4ffc-b5f8-4766f31a9546 tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:32:06.193487 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-fa5287a7-df4c-4ffc-b5f8-4766f31a9546 tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:32:06.364327 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-a6d3afb2-a372-4302-b861-ef2a1e7661d6 tempest-VolumesNegativeTest-1214922722 tempest-VolumesNegativeTest-1214922722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37a5ceff981447c4a65c0f2cec7607a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd9fedf211d41878c431ee91f87aaf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:32:06.382714 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-a6d3afb2-a372-4302-b861-ef2a1e7661d6 tempest-VolumesNegativeTest-1214922722 tempest-VolumesNegativeTest-1214922722-project] 10.222.0.33 "GET /compute/v2.1/servers/afd07f97-a630-410b-88c8-ce71e4f9eb32" status: 200 len: 1429 microversion: 2.1 time: 0.215035 Jul 18 10:32:06.383633 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 221/437] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:32:06 2022] GET /compute/v2.1/servers/afd07f97-a630-410b-88c8-ce71e4f9eb32 => generated 1429 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:32:06.389074 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [req-a2a4118a-8c88-4e20-a864-dd77d5bd75db req-8434ca2d-1e56-47f4-97f7-0bbf6874eea9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "afd07f97-a630-410b-88c8-ce71e4f9eb32", "name": "network-vif-deleted", "tag": "8a18070f-25e3-4429-b290-643f2e4e970a"}]} {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:32:06.400105 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [req-a2a4118a-8c88-4e20-a864-dd77d5bd75db req-8434ca2d-1e56-47f4-97f7-0bbf6874eea9 service nova] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:32:06.400769 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [req-a2a4118a-8c88-4e20-a864-dd77d5bd75db req-8434ca2d-1e56-47f4-97f7-0bbf6874eea9 service nova] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:32:06.423537 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.compute.server_external_events [req-a2a4118a-8c88-4e20-a864-dd77d5bd75db req-8434ca2d-1e56-47f4-97f7-0bbf6874eea9 service nova] Creating event network-vif-deleted:8a18070f-25e3-4429-b290-643f2e4e970a for instance afd07f97-a630-410b-88c8-ce71e4f9eb32 on hv-cinder-83754 Jul 18 10:32:06.430016 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [req-a2a4118a-8c88-4e20-a864-dd77d5bd75db req-8434ca2d-1e56-47f4-97f7-0bbf6874eea9 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044931 Jul 18 10:32:06.430708 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 222/438] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jul 18 10:32:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:32:06.437073 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-5de8e961-57fd-4fbe-b461-8b1980769923 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:32:06.437834 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-5de8e961-57fd-4fbe-b461-8b1980769923 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] [instance: 83b29c39-45ca-4cb3-ad7d-f7bd47bfe667] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:32:06.444940 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-5de8e961-57fd-4fbe-b461-8b1980769923 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:32:06.445401 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-5de8e961-57fd-4fbe-b461-8b1980769923 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:32:06.446214 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-5de8e961-57fd-4fbe-b461-8b1980769923 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:32:06.446659 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-5de8e961-57fd-4fbe-b461-8b1980769923 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:32:06.495846 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-fa5287a7-df4c-4ffc-b5f8-4766f31a9546 tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c9439cb644548b8b3b5fd5c610757b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6203312784435b8cd1fdfede3fb597', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:32:06.513216 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-fa5287a7-df4c-4ffc-b5f8-4766f31a9546 tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] 10.222.0.33 "GET /compute/v2.1/servers/a6d1079b-c5d3-4062-9759-b681711cef09" status: 200 len: 1319 microversion: 2.1 time: 0.338861 Jul 18 10:32:06.514961 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 217/439] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:32:06 2022] GET /compute/v2.1/servers/a6d1079b-c5d3-4062-9759-b681711cef09 => generated 1319 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:32:06.700980 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-5de8e961-57fd-4fbe-b461-8b1980769923 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af30265de71409d876112350949a2a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f62ef510c8484995a2f31f29104f399f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:32:06.717317 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-5de8e961-57fd-4fbe-b461-8b1980769923 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] 10.222.0.33 "GET /compute/v2.1/servers/83b29c39-45ca-4cb3-ad7d-f7bd47bfe667" status: 200 len: 1359 microversion: 2.1 time: 0.285419 Jul 18 10:32:06.720895 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 223/440] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:32:06 2022] GET /compute/v2.1/servers/83b29c39-45ca-4cb3-ad7d-f7bd47bfe667 => generated 1359 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:32:07.401048 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-64a7608d-4680-4e8b-95be-9d1ce385b5ef tempest-VolumesNegativeTest-1214922722 tempest-VolumesNegativeTest-1214922722-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:32:07.401832 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-64a7608d-4680-4e8b-95be-9d1ce385b5ef tempest-VolumesNegativeTest-1214922722 tempest-VolumesNegativeTest-1214922722-project] [instance: afd07f97-a630-410b-88c8-ce71e4f9eb32] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:32:07.408682 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-64a7608d-4680-4e8b-95be-9d1ce385b5ef tempest-VolumesNegativeTest-1214922722 tempest-VolumesNegativeTest-1214922722-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:32:07.409087 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-64a7608d-4680-4e8b-95be-9d1ce385b5ef tempest-VolumesNegativeTest-1214922722 tempest-VolumesNegativeTest-1214922722-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:32:07.409834 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-64a7608d-4680-4e8b-95be-9d1ce385b5ef tempest-VolumesNegativeTest-1214922722 tempest-VolumesNegativeTest-1214922722-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:32:07.410263 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-64a7608d-4680-4e8b-95be-9d1ce385b5ef tempest-VolumesNegativeTest-1214922722 tempest-VolumesNegativeTest-1214922722-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:32:07.423947 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.wsgi [None req-64a7608d-4680-4e8b-95be-9d1ce385b5ef tempest-VolumesNegativeTest-1214922722 tempest-VolumesNegativeTest-1214922722-project] HTTP exception thrown: Instance afd07f97-a630-410b-88c8-ce71e4f9eb32 could not be found. Jul 18 10:32:07.425607 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-64a7608d-4680-4e8b-95be-9d1ce385b5ef tempest-VolumesNegativeTest-1214922722 tempest-VolumesNegativeTest-1214922722-project] Request method failure captured: Jul 18 10:32:07.425607 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: request: GET /compute/v2.1/servers/afd07f97-a630-410b-88c8-ce71e4f9eb32 HTTP/1.1 Jul 18 10:32:07.425607 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: Accept: application/json Jul 18 10:32:07.425607 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: Accept-Encoding: identity Jul 18 10:32:07.425607 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: Connection: close Jul 18 10:32:07.425607 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: Content-Length: 0 Jul 18 10:32:07.425607 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: Content-Type: application/json Jul 18 10:32:07.425607 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: Host: 10.222.0.33 Jul 18 10:32:07.425607 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: Openstack-System-Scope: None Jul 18 10:32:07.425607 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: User-Agent: python-urllib3/1.26.9 Jul 18 10:32:07.425607 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Auth-Token: gAAAAABi1TaFsRHuzmEsPu_c1PB4XdMU-evYQQji71YWoM2Ccd9YfGHjnDcimQVICRk8LfJMCzQl6PqoB7_-wFjoeq5tZptIIWuhpRqCRlN5wqLkcpd3KCwC1EXToMBdjGpKIY15lp2j2mOQgm5r6YQxv_2TlBQKIYB_mWH3k5ZXYs2FTdTJX8s Jul 18 10:32:07.425607 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Domain-Id: None Jul 18 10:32:07.425607 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Domain-Name: None Jul 18 10:32:07.425607 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Identity-Status: Confirmed Jul 18 10:32:07.425607 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Is-Admin-Project: True Jul 18 10:32:07.425607 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Project-Domain-Id: default Jul 18 10:32:07.425607 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Project-Domain-Name: Default Jul 18 10:32:07.425607 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Project-Id: 0bd9fedf211d41878c431ee91f87aaf8 Jul 18 10:32:07.425607 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Project-Name: tempest-VolumesNegativeTest-1214922722 Jul 18 10:32:07.425607 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Role: member,reader Jul 18 10:32:07.425607 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Roles: member,reader Jul 18 10:32:07.427347 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0bd9fedf211d41878c431ee91f87aaf8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0bd9fedf211d41878c431ee91f87aaf8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/0bd9fedf211d41878c431ee91f87aaf8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_0bd9fedf211d41878c431ee91f87aaf8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jul 18 10:32:07.427347 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Tenant: tempest-VolumesNegativeTest-1214922722 Jul 18 10:32:07.427347 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Tenant-Id: 0bd9fedf211d41878c431ee91f87aaf8 Jul 18 10:32:07.427347 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Tenant-Name: tempest-VolumesNegativeTest-1214922722 Jul 18 10:32:07.427347 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-User: tempest-VolumesNegativeTest-1214922722-project Jul 18 10:32:07.427347 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-User-Domain-Id: default Jul 18 10:32:07.427347 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-User-Domain-Name: Default Jul 18 10:32:07.427347 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-User-Id: 37a5ceff981447c4a65c0f2cec7607a0 Jul 18 10:32:07.427347 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-User-Name: tempest-VolumesNegativeTest-1214922722-project Jul 18 10:32:07.427347 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: method: > Jul 18 10:32:07.427347 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: exception: Instance afd07f97-a630-410b-88c8-ce71e4f9eb32 could not be found. Jul 18 10:32:07.427347 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: action_args: {'id': 'afd07f97-a630-410b-88c8-ce71e4f9eb32'} Jul 18 10:32:07.428396 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 10:32:07.428396 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:32:07.428396 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 10:32:07.428396 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 10:32:07.428396 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 10:32:07.428396 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 10:32:07.428396 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 10:32:07.428396 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 10:32:07.428396 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 10:32:07.428396 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 10:32:07.428396 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance afd07f97-a630-410b-88c8-ce71e4f9eb32 could not be found. Jul 18 10:32:07.428396 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi Jul 18 10:32:07.428396 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:32:07.428396 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi Jul 18 10:32:07.428396 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:32:07.428396 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:32:07.428396 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:32:07.428396 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 10:32:07.428396 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 10:32:07.428396 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 10:32:07.429959 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 10:32:07.429959 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 10:32:07.429959 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 10:32:07.429959 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 10:32:07.429959 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 10:32:07.429959 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 10:32:07.429959 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 10:32:07.429959 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance afd07f97-a630-410b-88c8-ce71e4f9eb32 could not be found. Jul 18 10:32:07.429959 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi Jul 18 10:32:07.429959 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:32:07.429959 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi Jul 18 10:32:07.429959 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:32:07.429959 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:32:07.429959 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:32:07.429959 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 10:32:07.429959 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 10:32:07.429959 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance afd07f97-a630-410b-88c8-ce71e4f9eb32 could not be found. Jul 18 10:32:07.429959 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi Jul 18 10:32:07.431209 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-64a7608d-4680-4e8b-95be-9d1ce385b5ef tempest-VolumesNegativeTest-1214922722 tempest-VolumesNegativeTest-1214922722-project] Returning 404 to user: Instance afd07f97-a630-410b-88c8-ce71e4f9eb32 could not be found. {{(pid=117880) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 10:32:07.431209 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-64a7608d-4680-4e8b-95be-9d1ce385b5ef tempest-VolumesNegativeTest-1214922722 tempest-VolumesNegativeTest-1214922722-project] 10.222.0.33 "GET /compute/v2.1/servers/afd07f97-a630-410b-88c8-ce71e4f9eb32" status: 404 len: 111 microversion: 2.1 time: 0.029826 Jul 18 10:32:07.431661 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 218/441] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:32:07 2022] GET /compute/v2.1/servers/afd07f97-a630-410b-88c8-ce71e4f9eb32 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 10:32:07.531182 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-1d0fc610-6537-4bf3-8313-549f7281b881 tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:32:07.531786 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-1d0fc610-6537-4bf3-8313-549f7281b881 tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] [instance: a6d1079b-c5d3-4062-9759-b681711cef09] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:32:07.539582 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-1d0fc610-6537-4bf3-8313-549f7281b881 tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:32:07.540025 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-1d0fc610-6537-4bf3-8313-549f7281b881 tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:32:07.540820 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-1d0fc610-6537-4bf3-8313-549f7281b881 tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:32:07.541251 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-1d0fc610-6537-4bf3-8313-549f7281b881 tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:32:07.545451 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG dbcounter [-] [117879] Writing DB stats nova_cell1:SELECT=100 {{(pid=117879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:32:07.679493 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-1d0fc610-6537-4bf3-8313-549f7281b881 tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c9439cb644548b8b3b5fd5c610757b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6203312784435b8cd1fdfede3fb597', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:32:07.687200 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-1d0fc610-6537-4bf3-8313-549f7281b881 tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] 10.222.0.33 "GET /compute/v2.1/servers/a6d1079b-c5d3-4062-9759-b681711cef09" status: 200 len: 1319 microversion: 2.1 time: 0.160026 Jul 18 10:32:07.687765 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 224/442] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:32:07 2022] GET /compute/v2.1/servers/a6d1079b-c5d3-4062-9759-b681711cef09 => generated 1319 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:32:07.736633 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-4e69f0d1-ba97-476d-8a70-880bd5880f72 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:32:07.737234 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-4e69f0d1-ba97-476d-8a70-880bd5880f72 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] [instance: 83b29c39-45ca-4cb3-ad7d-f7bd47bfe667] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:32:07.743623 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-4e69f0d1-ba97-476d-8a70-880bd5880f72 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:32:07.744067 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-4e69f0d1-ba97-476d-8a70-880bd5880f72 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:32:07.744842 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-4e69f0d1-ba97-476d-8a70-880bd5880f72 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:32:07.745445 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-4e69f0d1-ba97-476d-8a70-880bd5880f72 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:32:07.892974 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-4e69f0d1-ba97-476d-8a70-880bd5880f72 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af30265de71409d876112350949a2a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f62ef510c8484995a2f31f29104f399f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:32:07.900381 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-4e69f0d1-ba97-476d-8a70-880bd5880f72 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] 10.222.0.33 "GET /compute/v2.1/servers/83b29c39-45ca-4cb3-ad7d-f7bd47bfe667" status: 200 len: 1359 microversion: 2.1 time: 0.167575 Jul 18 10:32:07.900862 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 219/443] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:32:07 2022] GET /compute/v2.1/servers/83b29c39-45ca-4cb3-ad7d-f7bd47bfe667 => generated 1359 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:32:08.450043 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [req-0c3817d1-aaed-4a11-81b4-0a001dc20507 req-f4406ae7-bbc2-4557-9fe9-4330a3da6d47 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "83b29c39-45ca-4cb3-ad7d-f7bd47bfe667", "tag": "8763c93e-265a-48e3-9444-a3c09c88377b"}]} {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:32:08.458259 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [req-0c3817d1-aaed-4a11-81b4-0a001dc20507 req-f4406ae7-bbc2-4557-9fe9-4330a3da6d47 service nova] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:32:08.458705 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [req-0c3817d1-aaed-4a11-81b4-0a001dc20507 req-f4406ae7-bbc2-4557-9fe9-4330a3da6d47 service nova] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:32:08.469823 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.compute.server_external_events [req-0c3817d1-aaed-4a11-81b4-0a001dc20507 req-f4406ae7-bbc2-4557-9fe9-4330a3da6d47 service nova] Creating event network-changed:8763c93e-265a-48e3-9444-a3c09c88377b for instance 83b29c39-45ca-4cb3-ad7d-f7bd47bfe667 on hv-cinder-83754 Jul 18 10:32:08.474545 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [req-0c3817d1-aaed-4a11-81b4-0a001dc20507 req-f4406ae7-bbc2-4557-9fe9-4330a3da6d47 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028405 Jul 18 10:32:08.475186 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 225/444] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jul 18 10:32:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:32:08.705252 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-e76040bd-487f-4b5e-af22-1975a44b500b tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:32:08.705859 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-e76040bd-487f-4b5e-af22-1975a44b500b tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] [instance: a6d1079b-c5d3-4062-9759-b681711cef09] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:32:08.712423 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-e76040bd-487f-4b5e-af22-1975a44b500b tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:32:08.713131 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-e76040bd-487f-4b5e-af22-1975a44b500b tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:32:08.713894 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-e76040bd-487f-4b5e-af22-1975a44b500b tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:32:08.714325 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-e76040bd-487f-4b5e-af22-1975a44b500b tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:32:08.919145 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-e82dc9e7-5965-4f1e-ae22-4ffff707fb0a tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:32:08.920407 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-e82dc9e7-5965-4f1e-ae22-4ffff707fb0a tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] [instance: 83b29c39-45ca-4cb3-ad7d-f7bd47bfe667] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:32:08.921825 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-e76040bd-487f-4b5e-af22-1975a44b500b tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c9439cb644548b8b3b5fd5c610757b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6203312784435b8cd1fdfede3fb597', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:32:08.929644 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-e82dc9e7-5965-4f1e-ae22-4ffff707fb0a tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:32:08.930095 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-e82dc9e7-5965-4f1e-ae22-4ffff707fb0a tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:32:08.930866 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-e82dc9e7-5965-4f1e-ae22-4ffff707fb0a tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:32:08.931299 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-e82dc9e7-5965-4f1e-ae22-4ffff707fb0a tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:32:08.939451 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-e76040bd-487f-4b5e-af22-1975a44b500b tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] 10.222.0.33 "GET /compute/v2.1/servers/a6d1079b-c5d3-4062-9759-b681711cef09" status: 200 len: 1319 microversion: 2.1 time: 0.237920 Jul 18 10:32:08.946524 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 220/445] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:32:08 2022] GET /compute/v2.1/servers/a6d1079b-c5d3-4062-9759-b681711cef09 => generated 1319 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:32:09.156393 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-e82dc9e7-5965-4f1e-ae22-4ffff707fb0a tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af30265de71409d876112350949a2a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f62ef510c8484995a2f31f29104f399f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:32:09.167261 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-e82dc9e7-5965-4f1e-ae22-4ffff707fb0a tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] 10.222.0.33 "GET /compute/v2.1/servers/83b29c39-45ca-4cb3-ad7d-f7bd47bfe667" status: 200 len: 1359 microversion: 2.1 time: 0.253171 Jul 18 10:32:09.167911 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 226/446] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:32:08 2022] GET /compute/v2.1/servers/83b29c39-45ca-4cb3-ad7d-f7bd47bfe667 => generated 1359 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:32:09.956738 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-4a4876b5-584f-49e5-a154-325da3bb0f7d tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:32:09.957417 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-4a4876b5-584f-49e5-a154-325da3bb0f7d tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] [instance: a6d1079b-c5d3-4062-9759-b681711cef09] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:32:09.964219 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-4a4876b5-584f-49e5-a154-325da3bb0f7d tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:32:09.964557 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-4a4876b5-584f-49e5-a154-325da3bb0f7d tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:32:09.969302 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-4a4876b5-584f-49e5-a154-325da3bb0f7d tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:32:09.969302 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-4a4876b5-584f-49e5-a154-325da3bb0f7d tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:32:10.115284 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-4a4876b5-584f-49e5-a154-325da3bb0f7d tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c9439cb644548b8b3b5fd5c610757b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6203312784435b8cd1fdfede3fb597', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:32:10.123007 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-4a4876b5-584f-49e5-a154-325da3bb0f7d tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] 10.222.0.33 "GET /compute/v2.1/servers/a6d1079b-c5d3-4062-9759-b681711cef09" status: 200 len: 1319 microversion: 2.1 time: 0.170676 Jul 18 10:32:10.124567 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 221/447] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:32:09 2022] GET /compute/v2.1/servers/a6d1079b-c5d3-4062-9759-b681711cef09 => generated 1319 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:32:10.184142 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-52fb99f1-b402-4dd8-a56f-4b09ea527cd4 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:32:10.184778 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-52fb99f1-b402-4dd8-a56f-4b09ea527cd4 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] [instance: 83b29c39-45ca-4cb3-ad7d-f7bd47bfe667] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:32:10.191553 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-52fb99f1-b402-4dd8-a56f-4b09ea527cd4 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:32:10.191927 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-52fb99f1-b402-4dd8-a56f-4b09ea527cd4 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:32:10.192763 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-52fb99f1-b402-4dd8-a56f-4b09ea527cd4 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:32:10.193210 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-52fb99f1-b402-4dd8-a56f-4b09ea527cd4 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:32:10.317237 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [req-5198c413-43e3-416f-9a2f-72d0194e3927 req-f814ea0d-31d0-4f57-bc0b-5db883386898 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a6d1079b-c5d3-4062-9759-b681711cef09", "name": "network-vif-plugged", "status": "completed", "tag": "6a2188b8-537d-4141-bb7c-a4099429ba7c"}]} {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:32:10.325627 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-52fb99f1-b402-4dd8-a56f-4b09ea527cd4 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af30265de71409d876112350949a2a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f62ef510c8484995a2f31f29104f399f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:32:10.330775 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [req-5198c413-43e3-416f-9a2f-72d0194e3927 req-f814ea0d-31d0-4f57-bc0b-5db883386898 service nova] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:32:10.331225 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [req-5198c413-43e3-416f-9a2f-72d0194e3927 req-f814ea0d-31d0-4f57-bc0b-5db883386898 service nova] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:32:10.342858 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-52fb99f1-b402-4dd8-a56f-4b09ea527cd4 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] 10.222.0.33 "GET /compute/v2.1/servers/83b29c39-45ca-4cb3-ad7d-f7bd47bfe667" status: 200 len: 1359 microversion: 2.1 time: 0.162294 Jul 18 10:32:10.343800 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 227/448] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:32:10 2022] GET /compute/v2.1/servers/83b29c39-45ca-4cb3-ad7d-f7bd47bfe667 => generated 1359 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:32:10.353796 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.compute.server_external_events [req-5198c413-43e3-416f-9a2f-72d0194e3927 req-f814ea0d-31d0-4f57-bc0b-5db883386898 service nova] Creating event network-vif-plugged:6a2188b8-537d-4141-bb7c-a4099429ba7c for instance a6d1079b-c5d3-4062-9759-b681711cef09 on hv-cinder-83754 Jul 18 10:32:10.356832 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [req-5198c413-43e3-416f-9a2f-72d0194e3927 req-f814ea0d-31d0-4f57-bc0b-5db883386898 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043545 Jul 18 10:32:10.357826 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 222/449] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jul 18 10:32:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 10:32:11.143495 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-a4f39131-3a36-4022-861c-09e4e80c86c1 tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:32:11.144098 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-a4f39131-3a36-4022-861c-09e4e80c86c1 tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] [instance: a6d1079b-c5d3-4062-9759-b681711cef09] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:32:11.153269 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-a4f39131-3a36-4022-861c-09e4e80c86c1 tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:32:11.153442 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-a4f39131-3a36-4022-861c-09e4e80c86c1 tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:32:11.154192 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-a4f39131-3a36-4022-861c-09e4e80c86c1 tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:32:11.154652 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-a4f39131-3a36-4022-861c-09e4e80c86c1 tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:32:11.291147 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-a4f39131-3a36-4022-861c-09e4e80c86c1 tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c9439cb644548b8b3b5fd5c610757b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6203312784435b8cd1fdfede3fb597', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:32:11.299297 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-a4f39131-3a36-4022-861c-09e4e80c86c1 tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] 10.222.0.33 "GET /compute/v2.1/servers/a6d1079b-c5d3-4062-9759-b681711cef09" status: 200 len: 1319 microversion: 2.1 time: 0.159620 Jul 18 10:32:11.299866 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 228/450] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:32:11 2022] GET /compute/v2.1/servers/a6d1079b-c5d3-4062-9759-b681711cef09 => generated 1319 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:32:11.362868 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-78b02052-f750-4f6c-9b4a-4706defcb54d tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:32:11.363683 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-78b02052-f750-4f6c-9b4a-4706defcb54d tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] [instance: 83b29c39-45ca-4cb3-ad7d-f7bd47bfe667] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:32:11.370029 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-78b02052-f750-4f6c-9b4a-4706defcb54d tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:32:11.370469 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-78b02052-f750-4f6c-9b4a-4706defcb54d tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:32:11.371219 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-78b02052-f750-4f6c-9b4a-4706defcb54d tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:32:11.371644 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-78b02052-f750-4f6c-9b4a-4706defcb54d tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:32:11.504720 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-78b02052-f750-4f6c-9b4a-4706defcb54d tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af30265de71409d876112350949a2a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f62ef510c8484995a2f31f29104f399f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:32:11.512060 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-78b02052-f750-4f6c-9b4a-4706defcb54d tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] 10.222.0.33 "GET /compute/v2.1/servers/83b29c39-45ca-4cb3-ad7d-f7bd47bfe667" status: 200 len: 1359 microversion: 2.1 time: 0.154522 Jul 18 10:32:11.512633 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 223/451] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:32:11 2022] GET /compute/v2.1/servers/83b29c39-45ca-4cb3-ad7d-f7bd47bfe667 => generated 1359 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:32:12.315866 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-ee9d160c-bf6a-4e41-a17f-9dd645749da0 tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:32:12.316624 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-ee9d160c-bf6a-4e41-a17f-9dd645749da0 tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] [instance: a6d1079b-c5d3-4062-9759-b681711cef09] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:32:12.323024 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-ee9d160c-bf6a-4e41-a17f-9dd645749da0 tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:32:12.323473 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-ee9d160c-bf6a-4e41-a17f-9dd645749da0 tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:32:12.324232 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-ee9d160c-bf6a-4e41-a17f-9dd645749da0 tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:32:12.324702 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-ee9d160c-bf6a-4e41-a17f-9dd645749da0 tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:32:12.388948 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [req-c6d59179-90d7-4253-b1f9-571af661da3f req-800f5c5d-8d5f-404c-a31e-da675b85f244 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "83b29c39-45ca-4cb3-ad7d-f7bd47bfe667", "name": "network-vif-plugged", "status": "completed", "tag": "8763c93e-265a-48e3-9444-a3c09c88377b"}]} {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:32:12.401940 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [req-c6d59179-90d7-4253-b1f9-571af661da3f req-800f5c5d-8d5f-404c-a31e-da675b85f244 service nova] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:32:12.402396 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [req-c6d59179-90d7-4253-b1f9-571af661da3f req-800f5c5d-8d5f-404c-a31e-da675b85f244 service nova] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:32:12.418339 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.compute.server_external_events [req-c6d59179-90d7-4253-b1f9-571af661da3f req-800f5c5d-8d5f-404c-a31e-da675b85f244 service nova] Creating event network-vif-plugged:8763c93e-265a-48e3-9444-a3c09c88377b for instance 83b29c39-45ca-4cb3-ad7d-f7bd47bfe667 on hv-cinder-83754 Jul 18 10:32:12.423644 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [req-c6d59179-90d7-4253-b1f9-571af661da3f req-800f5c5d-8d5f-404c-a31e-da675b85f244 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038178 Jul 18 10:32:12.424435 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 224/452] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jul 18 10:32:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:32:12.463280 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-ee9d160c-bf6a-4e41-a17f-9dd645749da0 tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c9439cb644548b8b3b5fd5c610757b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6203312784435b8cd1fdfede3fb597', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:32:12.470805 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-ee9d160c-bf6a-4e41-a17f-9dd645749da0 tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] 10.222.0.33 "GET /compute/v2.1/servers/a6d1079b-c5d3-4062-9759-b681711cef09" status: 200 len: 1508 microversion: 2.1 time: 0.159218 Jul 18 10:32:12.471568 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 229/453] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:32:12 2022] GET /compute/v2.1/servers/a6d1079b-c5d3-4062-9759-b681711cef09 => generated 1508 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:32:12.488296 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-33ed8d1c-1a13-4670-b4b3-23bfc2a1baa2 tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "14932826-4cd7-41b3-b5ec-91c46b9dd29d", "device": "/dev/sdb"}} {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:32:12.490298 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-33ed8d1c-1a13-4670-b4b3-23bfc2a1baa2 tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] [instance: a6d1079b-c5d3-4062-9759-b681711cef09] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:32:12.501737 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-33ed8d1c-1a13-4670-b4b3-23bfc2a1baa2 tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:32:12.502041 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-33ed8d1c-1a13-4670-b4b3-23bfc2a1baa2 tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:32:12.502885 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-33ed8d1c-1a13-4670-b4b3-23bfc2a1baa2 tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:32:12.503375 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-33ed8d1c-1a13-4670-b4b3-23bfc2a1baa2 tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:32:12.529416 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-53b969cd-d424-4b38-a315-ba357b1ed7cb tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:32:12.530174 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-53b969cd-d424-4b38-a315-ba357b1ed7cb tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] [instance: 83b29c39-45ca-4cb3-ad7d-f7bd47bfe667] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:32:12.549873 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-53b969cd-d424-4b38-a315-ba357b1ed7cb tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:32:12.550334 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-53b969cd-d424-4b38-a315-ba357b1ed7cb tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:32:12.551130 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-53b969cd-d424-4b38-a315-ba357b1ed7cb tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:32:12.551571 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-53b969cd-d424-4b38-a315-ba357b1ed7cb tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:32:12.759182 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-53b969cd-d424-4b38-a315-ba357b1ed7cb tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af30265de71409d876112350949a2a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f62ef510c8484995a2f31f29104f399f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:32:12.769604 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-53b969cd-d424-4b38-a315-ba357b1ed7cb tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] 10.222.0.33 "GET /compute/v2.1/servers/83b29c39-45ca-4cb3-ad7d-f7bd47bfe667" status: 200 len: 1359 microversion: 2.1 time: 0.244281 Jul 18 10:32:12.770352 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 230/454] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:32:12 2022] GET /compute/v2.1/servers/83b29c39-45ca-4cb3-ad7d-f7bd47bfe667 => generated 1359 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:32:12.790925 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-33ed8d1c-1a13-4670-b4b3-23bfc2a1baa2 tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] 10.222.0.33 "POST /compute/v2.1/servers/a6d1079b-c5d3-4062-9759-b681711cef09/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.307131 Jul 18 10:32:12.791538 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 225/455] 10.222.0.33 () {60 vars in 1322 bytes} [Mon Jul 18 10:32:12 2022] POST /compute/v2.1/servers/a6d1079b-c5d3-4062-9759-b681711cef09/os-volume_attachments => generated 194 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:32:13.786030 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-0faa4a61-ec00-47c3-8eb9-d5c973fba2d6 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:32:13.786662 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-0faa4a61-ec00-47c3-8eb9-d5c973fba2d6 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] [instance: 83b29c39-45ca-4cb3-ad7d-f7bd47bfe667] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:32:13.792741 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-0faa4a61-ec00-47c3-8eb9-d5c973fba2d6 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:32:13.793216 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-0faa4a61-ec00-47c3-8eb9-d5c973fba2d6 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:32:13.793972 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-0faa4a61-ec00-47c3-8eb9-d5c973fba2d6 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:32:13.794405 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-0faa4a61-ec00-47c3-8eb9-d5c973fba2d6 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:32:13.929833 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-0faa4a61-ec00-47c3-8eb9-d5c973fba2d6 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af30265de71409d876112350949a2a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f62ef510c8484995a2f31f29104f399f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:32:13.937146 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-0faa4a61-ec00-47c3-8eb9-d5c973fba2d6 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] 10.222.0.33 "GET /compute/v2.1/servers/83b29c39-45ca-4cb3-ad7d-f7bd47bfe667" status: 200 len: 1359 microversion: 2.1 time: 0.154982 Jul 18 10:32:13.937715 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 231/456] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:32:13 2022] GET /compute/v2.1/servers/83b29c39-45ca-4cb3-ad7d-f7bd47bfe667 => generated 1359 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:32:14.954967 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-44e651ab-5bda-44d3-a0bb-4279cf8b4c35 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:32:14.955686 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-44e651ab-5bda-44d3-a0bb-4279cf8b4c35 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] [instance: 83b29c39-45ca-4cb3-ad7d-f7bd47bfe667] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:32:14.962197 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-44e651ab-5bda-44d3-a0bb-4279cf8b4c35 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:32:14.962637 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-44e651ab-5bda-44d3-a0bb-4279cf8b4c35 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:32:14.963414 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-44e651ab-5bda-44d3-a0bb-4279cf8b4c35 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:32:14.963866 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-44e651ab-5bda-44d3-a0bb-4279cf8b4c35 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:32:14.967756 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG dbcounter [-] [117880] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:32:15.094048 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-44e651ab-5bda-44d3-a0bb-4279cf8b4c35 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af30265de71409d876112350949a2a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f62ef510c8484995a2f31f29104f399f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:32:15.101852 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-44e651ab-5bda-44d3-a0bb-4279cf8b4c35 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] 10.222.0.33 "GET /compute/v2.1/servers/83b29c39-45ca-4cb3-ad7d-f7bd47bfe667" status: 200 len: 1359 microversion: 2.1 time: 0.151561 Jul 18 10:32:15.102395 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 226/457] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:32:14 2022] GET /compute/v2.1/servers/83b29c39-45ca-4cb3-ad7d-f7bd47bfe667 => generated 1359 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:32:16.118515 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-63e1409c-4ce4-4032-8788-3663abfd1aa0 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:32:16.119124 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-63e1409c-4ce4-4032-8788-3663abfd1aa0 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] [instance: 83b29c39-45ca-4cb3-ad7d-f7bd47bfe667] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:32:16.125555 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-63e1409c-4ce4-4032-8788-3663abfd1aa0 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:32:16.126008 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-63e1409c-4ce4-4032-8788-3663abfd1aa0 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:32:16.126769 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-63e1409c-4ce4-4032-8788-3663abfd1aa0 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:32:16.127203 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-63e1409c-4ce4-4032-8788-3663abfd1aa0 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:32:16.256330 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-63e1409c-4ce4-4032-8788-3663abfd1aa0 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af30265de71409d876112350949a2a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f62ef510c8484995a2f31f29104f399f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:32:16.263675 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-63e1409c-4ce4-4032-8788-3663abfd1aa0 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] 10.222.0.33 "GET /compute/v2.1/servers/83b29c39-45ca-4cb3-ad7d-f7bd47bfe667" status: 200 len: 1359 microversion: 2.1 time: 0.148939 Jul 18 10:32:16.264224 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 232/458] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:32:16 2022] GET /compute/v2.1/servers/83b29c39-45ca-4cb3-ad7d-f7bd47bfe667 => generated 1359 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:32:17.280586 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-8834a63c-f5c0-49ce-87b3-e579ab5c2c81 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:32:17.281200 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-8834a63c-f5c0-49ce-87b3-e579ab5c2c81 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] [instance: 83b29c39-45ca-4cb3-ad7d-f7bd47bfe667] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:32:17.289210 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-8834a63c-f5c0-49ce-87b3-e579ab5c2c81 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:32:17.289656 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-8834a63c-f5c0-49ce-87b3-e579ab5c2c81 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:32:17.290415 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-8834a63c-f5c0-49ce-87b3-e579ab5c2c81 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:32:17.290839 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-8834a63c-f5c0-49ce-87b3-e579ab5c2c81 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:32:17.421600 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-8834a63c-f5c0-49ce-87b3-e579ab5c2c81 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af30265de71409d876112350949a2a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f62ef510c8484995a2f31f29104f399f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:32:17.428902 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-8834a63c-f5c0-49ce-87b3-e579ab5c2c81 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] 10.222.0.33 "GET /compute/v2.1/servers/83b29c39-45ca-4cb3-ad7d-f7bd47bfe667" status: 200 len: 1359 microversion: 2.1 time: 0.152071 Jul 18 10:32:17.429460 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 227/459] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:32:17 2022] GET /compute/v2.1/servers/83b29c39-45ca-4cb3-ad7d-f7bd47bfe667 => generated 1359 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:32:17.834730 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-164a0604-d18f-4216-b1f2-bcfe4df37d3d tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:32:17.835272 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-164a0604-d18f-4216-b1f2-bcfe4df37d3d tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] [instance: 1e3ca3fe-e03a-47e3-9d9c-a6ab431e2dd7] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:32:17.841651 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-164a0604-d18f-4216-b1f2-bcfe4df37d3d tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:32:17.842097 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-164a0604-d18f-4216-b1f2-bcfe4df37d3d tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:32:17.842851 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-164a0604-d18f-4216-b1f2-bcfe4df37d3d tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:32:17.843310 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-164a0604-d18f-4216-b1f2-bcfe4df37d3d tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:32:17.866432 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-164a0604-d18f-4216-b1f2-bcfe4df37d3d tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] 10.222.0.33 "GET /compute/v2.1/servers/1e3ca3fe-e03a-47e3-9d9c-a6ab431e2dd7/ips" status: 200 len: 150 microversion: 2.1 time: 0.035537 Jul 18 10:32:17.867024 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 233/460] 10.222.0.33 () {58 vars in 1247 bytes} [Mon Jul 18 10:32:17 2022] GET /compute/v2.1/servers/1e3ca3fe-e03a-47e3-9d9c-a6ab431e2dd7/ips => generated 150 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:32:17.878058 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-bd70e780-4ae1-41d1-b6bb-3df8334e6b04 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a7283353-c48b-45f2-9b6f-aede9fbb96b4"}} {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:32:17.879163 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-bd70e780-4ae1-41d1-b6bb-3df8334e6b04 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] [instance: 1e3ca3fe-e03a-47e3-9d9c-a6ab431e2dd7] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:32:17.885990 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-bd70e780-4ae1-41d1-b6bb-3df8334e6b04 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:32:17.886435 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-bd70e780-4ae1-41d1-b6bb-3df8334e6b04 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:32:17.887194 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-bd70e780-4ae1-41d1-b6bb-3df8334e6b04 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:32:17.887626 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-bd70e780-4ae1-41d1-b6bb-3df8334e6b04 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:32:17.964154 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.wsgi [None req-bd70e780-4ae1-41d1-b6bb-3df8334e6b04 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] HTTP exception thrown: Invalid volume: volume a7283353-c48b-45f2-9b6f-aede9fbb96b4 is already attached to instances: db62c05e-28a8-4121-a6e5-8abb802f7a17 Jul 18 10:32:17.965875 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-bd70e780-4ae1-41d1-b6bb-3df8334e6b04 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Request method failure captured: Jul 18 10:32:17.965875 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: request: POST /compute/v2.1/servers/1e3ca3fe-e03a-47e3-9d9c-a6ab431e2dd7/os-volume_attachments HTTP/1.1 Jul 18 10:32:17.965875 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: Accept: application/json Jul 18 10:32:17.965875 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: Accept-Encoding: identity Jul 18 10:32:17.965875 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: Connection: close Jul 18 10:32:17.965875 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: Content-Length: 74 Jul 18 10:32:17.965875 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: Content-Type: application/json Jul 18 10:32:17.965875 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: Host: 10.222.0.33 Jul 18 10:32:17.965875 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: Openstack-System-Scope: None Jul 18 10:32:17.965875 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: User-Agent: python-urllib3/1.26.9 Jul 18 10:32:17.965875 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Auth-Token: gAAAAABi1TXs5d9KA6TlIG1Li_VNjhkDxvVxs6ByaKH91Tp5cEYBI8OTiNSNI40UEe5MBLfNqlyuYAjUMpiV_qMg9jtmq9fJwxP3wvSLbrM9kN7Z4diK5bpD5WWlO_9PNIu02mzK2QxOqaTdn-MDBEh-IwIUUSwgtjyQOUrIhUK0fhFwotym42k Jul 18 10:32:17.965875 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Domain-Id: None Jul 18 10:32:17.965875 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Domain-Name: None Jul 18 10:32:17.965875 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Identity-Status: Confirmed Jul 18 10:32:17.965875 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Is-Admin-Project: True Jul 18 10:32:17.965875 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Project-Domain-Id: default Jul 18 10:32:17.965875 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Project-Domain-Name: Default Jul 18 10:32:17.965875 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Project-Id: 1cf3d5bfe9a745f38372c42c9cfa1f63 Jul 18 10:32:17.965875 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Project-Name: tempest-AttachVolumeNegativeTest-653274830 Jul 18 10:32:17.965875 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Role: member,reader Jul 18 10:32:17.965875 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Roles: member,reader Jul 18 10:32:17.967405 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1cf3d5bfe9a745f38372c42c9cfa1f63"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1cf3d5bfe9a745f38372c42c9cfa1f63"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/1cf3d5bfe9a745f38372c42c9cfa1f63"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_1cf3d5bfe9a745f38372c42c9cfa1f63"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jul 18 10:32:17.967405 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Tenant: tempest-AttachVolumeNegativeTest-653274830 Jul 18 10:32:17.967405 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Tenant-Id: 1cf3d5bfe9a745f38372c42c9cfa1f63 Jul 18 10:32:17.967405 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-653274830 Jul 18 10:32:17.967405 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-User: tempest-AttachVolumeNegativeTest-653274830-project Jul 18 10:32:17.967405 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-User-Domain-Id: default Jul 18 10:32:17.967405 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-User-Domain-Name: Default Jul 18 10:32:17.967405 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-User-Id: f25c72896a2d4d619e5ad4b5a0a79aa6 Jul 18 10:32:17.967405 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-User-Name: tempest-AttachVolumeNegativeTest-653274830-project Jul 18 10:32:17.967405 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: Jul 18 10:32:17.967405 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: {"volumeAttachment": {"volumeId": "a7283353-c48b-45f2-9b6f-aede9fbb96b4"}} Jul 18 10:32:17.967405 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: method: > Jul 18 10:32:17.968351 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: exception: Invalid volume: volume a7283353-c48b-45f2-9b6f-aede9fbb96b4 is already attached to instances: db62c05e-28a8-4121-a6e5-8abb802f7a17 Jul 18 10:32:17.968351 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: action_args: {'server_id': '1e3ca3fe-e03a-47e3-9d9c-a6ab431e2dd7', 'body': {'volumeAttachment': {'volumeId': 'a7283353-c48b-45f2-9b6f-aede9fbb96b4'}}} Jul 18 10:32:17.968351 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 10:32:17.968351 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:32:17.968351 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 18 10:32:17.968351 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 18 10:32:17.968351 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 18 10:32:17.968351 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 18 10:32:17.968351 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 18 10:32:17.968351 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 18 10:32:17.968351 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jul 18 10:32:17.968351 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 18 10:32:17.968351 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jul 18 10:32:17.968351 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 18 10:32:17.968351 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume a7283353-c48b-45f2-9b6f-aede9fbb96b4 is already attached to instances: db62c05e-28a8-4121-a6e5-8abb802f7a17 Jul 18 10:32:17.968351 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi Jul 18 10:32:17.968351 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:32:17.968351 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi Jul 18 10:32:17.968351 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:32:17.969546 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:32:17.969546 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:32:17.969546 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 10:32:17.969546 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 10:32:17.969546 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 10:32:17.969546 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 10:32:17.969546 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 10:32:17.969546 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 10:32:17.969546 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 10:32:17.969546 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 10:32:17.969546 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 10:32:17.969546 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 10:32:17.969546 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 18 10:32:17.969546 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 18 10:32:17.969546 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume a7283353-c48b-45f2-9b6f-aede9fbb96b4 is already attached to instances: db62c05e-28a8-4121-a6e5-8abb802f7a17 Jul 18 10:32:17.969546 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi Jul 18 10:32:17.969546 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:32:17.969546 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi Jul 18 10:32:17.969546 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:32:17.969546 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:32:17.970717 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:32:17.970717 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 10:32:17.970717 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 10:32:17.970717 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume a7283353-c48b-45f2-9b6f-aede9fbb96b4 is already attached to instances: db62c05e-28a8-4121-a6e5-8abb802f7a17 Jul 18 10:32:17.970717 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi Jul 18 10:32:17.970717 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-bd70e780-4ae1-41d1-b6bb-3df8334e6b04 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Returning 400 to user: Invalid volume: volume a7283353-c48b-45f2-9b6f-aede9fbb96b4 is already attached to instances: db62c05e-28a8-4121-a6e5-8abb802f7a17 {{(pid=117880) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 10:32:17.970717 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-bd70e780-4ae1-41d1-b6bb-3df8334e6b04 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] 10.222.0.33 "POST /compute/v2.1/servers/1e3ca3fe-e03a-47e3-9d9c-a6ab431e2dd7/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.093861 Jul 18 10:32:17.970717 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 228/461] 10.222.0.33 () {60 vars in 1322 bytes} [Mon Jul 18 10:32:17 2022] POST /compute/v2.1/servers/1e3ca3fe-e03a-47e3-9d9c-a6ab431e2dd7/os-volume_attachments => generated 174 bytes in 95 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 18 10:32:17.976080 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-5990619a-d0cb-4731-b8ff-792f7bc45b28 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:32:17.976649 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-5990619a-d0cb-4731-b8ff-792f7bc45b28 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] [instance: 1e3ca3fe-e03a-47e3-9d9c-a6ab431e2dd7] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:32:17.982924 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-5990619a-d0cb-4731-b8ff-792f7bc45b28 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:32:17.983380 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-5990619a-d0cb-4731-b8ff-792f7bc45b28 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:32:17.984149 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-5990619a-d0cb-4731-b8ff-792f7bc45b28 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:32:17.985139 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-5990619a-d0cb-4731-b8ff-792f7bc45b28 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:32:18.009449 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-5990619a-d0cb-4731-b8ff-792f7bc45b28 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] [instance: 1e3ca3fe-e03a-47e3-9d9c-a6ab431e2dd7] Going to try to terminate instance {{(pid=117879) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 10:32:18.076307 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG dbcounter [-] [117879] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=117879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:32:18.084462 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-5990619a-d0cb-4731-b8ff-792f7bc45b28 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] 10.222.0.33 "DELETE /compute/v2.1/servers/1e3ca3fe-e03a-47e3-9d9c-a6ab431e2dd7" status: 204 len: 0 microversion: 2.1 time: 0.111809 Jul 18 10:32:18.085153 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 234/462] 10.222.0.33 () {58 vars in 1238 bytes} [Mon Jul 18 10:32:17 2022] DELETE /compute/v2.1/servers/1e3ca3fe-e03a-47e3-9d9c-a6ab431e2dd7 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 18 10:32:18.093714 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-019f6c1e-1a6d-4db9-8961-ba95bd5088ce tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:32:18.094323 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-019f6c1e-1a6d-4db9-8961-ba95bd5088ce tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] [instance: 1e3ca3fe-e03a-47e3-9d9c-a6ab431e2dd7] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:32:18.100444 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-019f6c1e-1a6d-4db9-8961-ba95bd5088ce tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:32:18.100920 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-019f6c1e-1a6d-4db9-8961-ba95bd5088ce tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:32:18.101680 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-019f6c1e-1a6d-4db9-8961-ba95bd5088ce tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:32:18.102111 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-019f6c1e-1a6d-4db9-8961-ba95bd5088ce tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:32:18.231483 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-019f6c1e-1a6d-4db9-8961-ba95bd5088ce tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f25c72896a2d4d619e5ad4b5a0a79aa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cf3d5bfe9a745f38372c42c9cfa1f63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:32:18.239571 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-019f6c1e-1a6d-4db9-8961-ba95bd5088ce tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] 10.222.0.33 "GET /compute/v2.1/servers/1e3ca3fe-e03a-47e3-9d9c-a6ab431e2dd7" status: 200 len: 1682 microversion: 2.1 time: 0.149946 Jul 18 10:32:18.240121 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 229/463] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:32:18 2022] GET /compute/v2.1/servers/1e3ca3fe-e03a-47e3-9d9c-a6ab431e2dd7 => generated 1682 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:32:18.410509 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-9b6e05f3-196f-4dfb-830d-6eb0e22a6015 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "763d6f81-f7c8-4a96-be85-5afcc42a6739"}} {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:32:18.411858 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-9b6e05f3-196f-4dfb-830d-6eb0e22a6015 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] [instance: a3dbac58-662d-4720-8bcf-2300f9a9a5d1] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:32:18.421249 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-9b6e05f3-196f-4dfb-830d-6eb0e22a6015 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:32:18.421249 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-9b6e05f3-196f-4dfb-830d-6eb0e22a6015 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:32:18.421249 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-9b6e05f3-196f-4dfb-830d-6eb0e22a6015 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:32:18.421249 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-9b6e05f3-196f-4dfb-830d-6eb0e22a6015 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:32:18.446985 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-662de7c5-5d72-4810-8af7-d6d788945442 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:32:18.446985 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-662de7c5-5d72-4810-8af7-d6d788945442 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] [instance: 83b29c39-45ca-4cb3-ad7d-f7bd47bfe667] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:32:18.452936 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-662de7c5-5d72-4810-8af7-d6d788945442 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:32:18.453464 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-662de7c5-5d72-4810-8af7-d6d788945442 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:32:18.454380 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-662de7c5-5d72-4810-8af7-d6d788945442 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:32:18.454882 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-662de7c5-5d72-4810-8af7-d6d788945442 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:32:18.600129 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-662de7c5-5d72-4810-8af7-d6d788945442 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af30265de71409d876112350949a2a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f62ef510c8484995a2f31f29104f399f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:32:18.609145 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-662de7c5-5d72-4810-8af7-d6d788945442 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] 10.222.0.33 "GET /compute/v2.1/servers/83b29c39-45ca-4cb3-ad7d-f7bd47bfe667" status: 200 len: 1549 microversion: 2.1 time: 0.167043 Jul 18 10:32:18.609912 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 230/464] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:32:18 2022] GET /compute/v2.1/servers/83b29c39-45ca-4cb3-ad7d-f7bd47bfe667 => generated 1549 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:32:18.625097 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-109ffe83-7fc2-46e6-9b9d-3104c0604868 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:32:18.625719 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-109ffe83-7fc2-46e6-9b9d-3104c0604868 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] [instance: 83b29c39-45ca-4cb3-ad7d-f7bd47bfe667] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:32:18.631458 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-109ffe83-7fc2-46e6-9b9d-3104c0604868 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:32:18.631900 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-109ffe83-7fc2-46e6-9b9d-3104c0604868 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:32:18.632670 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-109ffe83-7fc2-46e6-9b9d-3104c0604868 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:32:18.633096 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-109ffe83-7fc2-46e6-9b9d-3104c0604868 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:32:18.759622 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-109ffe83-7fc2-46e6-9b9d-3104c0604868 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af30265de71409d876112350949a2a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f62ef510c8484995a2f31f29104f399f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:32:18.767411 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-109ffe83-7fc2-46e6-9b9d-3104c0604868 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] 10.222.0.33 "GET /compute/v2.1/servers/83b29c39-45ca-4cb3-ad7d-f7bd47bfe667" status: 200 len: 1549 microversion: 2.1 time: 0.145914 Jul 18 10:32:18.767954 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 231/465] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:32:18 2022] GET /compute/v2.1/servers/83b29c39-45ca-4cb3-ad7d-f7bd47bfe667 => generated 1549 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:32:18.782862 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-79a9f51d-7dad-430c-a2f2-e2ec20d310a2 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:32:18.786291 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-79a9f51d-7dad-430c-a2f2-e2ec20d310a2 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '1af30265de71409d876112350949a2a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f62ef510c8484995a2f31f29104f399f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:32:18.787042 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-79a9f51d-7dad-430c-a2f2-e2ec20d310a2 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Searching by: {'deleted': False, 'project_id': 'f62ef510c8484995a2f31f29104f399f'} {{(pid=117880) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 18 10:32:18.793351 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-79a9f51d-7dad-430c-a2f2-e2ec20d310a2 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:32:18.793788 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-79a9f51d-7dad-430c-a2f2-e2ec20d310a2 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:32:18.794565 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-79a9f51d-7dad-430c-a2f2-e2ec20d310a2 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:32:18.794995 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-79a9f51d-7dad-430c-a2f2-e2ec20d310a2 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:32:18.883853 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.multi_cell_list [None req-79a9f51d-7dad-430c-a2f2-e2ec20d310a2 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=117880) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 18 10:32:18.982983 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-79a9f51d-7dad-430c-a2f2-e2ec20d310a2 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] 10.222.0.33 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.204055 Jul 18 10:32:18.983556 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 232/466] 10.222.0.33 () {58 vars in 1124 bytes} [Mon Jul 18 10:32:18 2022] GET /compute/v2.1/servers => generated 343 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 10:32:18.993325 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-37e509df-db82-41ab-89c2-812910a7fe76 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:32:18.993936 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-37e509df-db82-41ab-89c2-812910a7fe76 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] [instance: 83b29c39-45ca-4cb3-ad7d-f7bd47bfe667] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:32:18.999610 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-37e509df-db82-41ab-89c2-812910a7fe76 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:32:19.000061 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-37e509df-db82-41ab-89c2-812910a7fe76 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:32:19.001361 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-37e509df-db82-41ab-89c2-812910a7fe76 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:32:19.001798 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-37e509df-db82-41ab-89c2-812910a7fe76 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:32:19.126858 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-37e509df-db82-41ab-89c2-812910a7fe76 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af30265de71409d876112350949a2a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f62ef510c8484995a2f31f29104f399f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:32:19.134374 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-37e509df-db82-41ab-89c2-812910a7fe76 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] 10.222.0.33 "GET /compute/v2.1/servers/83b29c39-45ca-4cb3-ad7d-f7bd47bfe667" status: 200 len: 1549 microversion: 2.1 time: 0.144477 Jul 18 10:32:19.134874 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 233/467] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:32:18 2022] GET /compute/v2.1/servers/83b29c39-45ca-4cb3-ad7d-f7bd47bfe667 => generated 1549 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:32:19.256398 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-7cda8533-4beb-4ee6-a9fc-3294e7974b43 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:32:19.257034 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-7cda8533-4beb-4ee6-a9fc-3294e7974b43 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] [instance: 1e3ca3fe-e03a-47e3-9d9c-a6ab431e2dd7] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:32:19.262951 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-7cda8533-4beb-4ee6-a9fc-3294e7974b43 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:32:19.263406 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-7cda8533-4beb-4ee6-a9fc-3294e7974b43 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:32:19.264480 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-7cda8533-4beb-4ee6-a9fc-3294e7974b43 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:32:19.264615 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-7cda8533-4beb-4ee6-a9fc-3294e7974b43 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:32:19.412833 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-7cda8533-4beb-4ee6-a9fc-3294e7974b43 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f25c72896a2d4d619e5ad4b5a0a79aa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cf3d5bfe9a745f38372c42c9cfa1f63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:32:19.420599 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-7cda8533-4beb-4ee6-a9fc-3294e7974b43 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] 10.222.0.33 "GET /compute/v2.1/servers/1e3ca3fe-e03a-47e3-9d9c-a6ab431e2dd7" status: 200 len: 1682 microversion: 2.1 time: 0.167983 Jul 18 10:32:19.421255 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 234/468] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:32:19 2022] GET /compute/v2.1/servers/1e3ca3fe-e03a-47e3-9d9c-a6ab431e2dd7 => generated 1682 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:32:20.351542 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-9b6e05f3-196f-4dfb-830d-6eb0e22a6015 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] 10.222.0.33 "POST /compute/v2.1/servers/a3dbac58-662d-4720-8bcf-2300f9a9a5d1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.946115 Jul 18 10:32:20.352157 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 235/469] 10.222.0.33 () {60 vars in 1322 bytes} [Mon Jul 18 10:32:18 2022] POST /compute/v2.1/servers/a3dbac58-662d-4720-8bcf-2300f9a9a5d1/os-volume_attachments => generated 194 bytes in 1948 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:32:20.439103 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-f9c56047-9a52-47c3-b779-bd6aa88caf25 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:32:20.439709 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-f9c56047-9a52-47c3-b779-bd6aa88caf25 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] [instance: 1e3ca3fe-e03a-47e3-9d9c-a6ab431e2dd7] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:32:20.446328 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-f9c56047-9a52-47c3-b779-bd6aa88caf25 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:32:20.446780 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-f9c56047-9a52-47c3-b779-bd6aa88caf25 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:32:20.447542 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-f9c56047-9a52-47c3-b779-bd6aa88caf25 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:32:20.447997 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-f9c56047-9a52-47c3-b779-bd6aa88caf25 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:32:20.590923 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-f9c56047-9a52-47c3-b779-bd6aa88caf25 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f25c72896a2d4d619e5ad4b5a0a79aa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cf3d5bfe9a745f38372c42c9cfa1f63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:32:20.600216 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-f9c56047-9a52-47c3-b779-bd6aa88caf25 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] 10.222.0.33 "GET /compute/v2.1/servers/1e3ca3fe-e03a-47e3-9d9c-a6ab431e2dd7" status: 200 len: 1682 microversion: 2.1 time: 0.165272 Jul 18 10:32:20.601795 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 235/470] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:32:20 2022] GET /compute/v2.1/servers/1e3ca3fe-e03a-47e3-9d9c-a6ab431e2dd7 => generated 1682 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:32:20.667066 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-b8911101-93f3-4ccb-a919-f3d500c412b6 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9a55a428-fdbb-429d-8a61-e7c5f0c51092"}} {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:32:20.668268 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-b8911101-93f3-4ccb-a919-f3d500c412b6 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] [instance: 83b29c39-45ca-4cb3-ad7d-f7bd47bfe667] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:32:20.675225 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-b8911101-93f3-4ccb-a919-f3d500c412b6 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:32:20.675693 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-b8911101-93f3-4ccb-a919-f3d500c412b6 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:32:20.676474 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-b8911101-93f3-4ccb-a919-f3d500c412b6 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:32:20.676924 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-b8911101-93f3-4ccb-a919-f3d500c412b6 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:32:21.027861 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-b8911101-93f3-4ccb-a919-f3d500c412b6 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] 10.222.0.33 "POST /compute/v2.1/servers/83b29c39-45ca-4cb3-ad7d-f7bd47bfe667/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.365285 Jul 18 10:32:21.028888 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 236/471] 10.222.0.33 () {60 vars in 1322 bytes} [Mon Jul 18 10:32:20 2022] POST /compute/v2.1/servers/83b29c39-45ca-4cb3-ad7d-f7bd47bfe667/os-volume_attachments => generated 194 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:32:21.619060 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-db8d566f-5c43-4e88-90a8-781dc42f9bf2 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:32:21.619779 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-db8d566f-5c43-4e88-90a8-781dc42f9bf2 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] [instance: 1e3ca3fe-e03a-47e3-9d9c-a6ab431e2dd7] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:32:21.627034 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-db8d566f-5c43-4e88-90a8-781dc42f9bf2 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:32:21.627569 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-db8d566f-5c43-4e88-90a8-781dc42f9bf2 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:32:21.628415 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-db8d566f-5c43-4e88-90a8-781dc42f9bf2 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:32:21.628942 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-db8d566f-5c43-4e88-90a8-781dc42f9bf2 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:32:21.717665 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-db8d566f-5c43-4e88-90a8-781dc42f9bf2 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f25c72896a2d4d619e5ad4b5a0a79aa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cf3d5bfe9a745f38372c42c9cfa1f63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:32:21.733643 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-db8d566f-5c43-4e88-90a8-781dc42f9bf2 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] 10.222.0.33 "GET /compute/v2.1/servers/1e3ca3fe-e03a-47e3-9d9c-a6ab431e2dd7" status: 200 len: 1615 microversion: 2.1 time: 0.118592 Jul 18 10:32:21.740580 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 236/472] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:32:21 2022] GET /compute/v2.1/servers/1e3ca3fe-e03a-47e3-9d9c-a6ab431e2dd7 => generated 1615 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:32:21.764975 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [req-b77c12e5-b436-4ce8-bef5-ce6f508daf2f req-12ccf3ae-b0eb-47ae-be7b-fd8f40205b1c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e3ca3fe-e03a-47e3-9d9c-a6ab431e2dd7", "name": "network-vif-deleted", "tag": "45d07fc3-9cad-4182-885d-f3a4c1ec9917"}]} {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:32:21.777869 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [req-b77c12e5-b436-4ce8-bef5-ce6f508daf2f req-12ccf3ae-b0eb-47ae-be7b-fd8f40205b1c service nova] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:32:21.778271 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [req-b77c12e5-b436-4ce8-bef5-ce6f508daf2f req-12ccf3ae-b0eb-47ae-be7b-fd8f40205b1c service nova] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:32:21.810316 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.compute.server_external_events [req-b77c12e5-b436-4ce8-bef5-ce6f508daf2f req-12ccf3ae-b0eb-47ae-be7b-fd8f40205b1c service nova] Creating event network-vif-deleted:45d07fc3-9cad-4182-885d-f3a4c1ec9917 for instance 1e3ca3fe-e03a-47e3-9d9c-a6ab431e2dd7 on hv-cinder-83754 Jul 18 10:32:21.818110 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [req-b77c12e5-b436-4ce8-bef5-ce6f508daf2f req-12ccf3ae-b0eb-47ae-be7b-fd8f40205b1c service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058294 Jul 18 10:32:21.818948 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 237/473] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jul 18 10:32:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:32:22.752225 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-2994073b-7150-457b-9677-d4f2c5eb57ac tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:32:22.752885 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-2994073b-7150-457b-9677-d4f2c5eb57ac tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] [instance: 1e3ca3fe-e03a-47e3-9d9c-a6ab431e2dd7] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:32:22.766739 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-2994073b-7150-457b-9677-d4f2c5eb57ac tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:32:22.767195 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-2994073b-7150-457b-9677-d4f2c5eb57ac tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:32:22.767990 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-2994073b-7150-457b-9677-d4f2c5eb57ac tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:32:22.768424 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-2994073b-7150-457b-9677-d4f2c5eb57ac tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:32:22.807856 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-2994073b-7150-457b-9677-d4f2c5eb57ac tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:32:22.808562 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-2994073b-7150-457b-9677-d4f2c5eb57ac tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:32:22.809394 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.objects.instance [None req-2994073b-7150-457b-9677-d4f2c5eb57ac tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lazy-loading 'fault' on Instance uuid 1e3ca3fe-e03a-47e3-9d9c-a6ab431e2dd7 {{(pid=117880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 10:32:23.032438 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-2994073b-7150-457b-9677-d4f2c5eb57ac tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f25c72896a2d4d619e5ad4b5a0a79aa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cf3d5bfe9a745f38372c42c9cfa1f63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:32:23.044880 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-2994073b-7150-457b-9677-d4f2c5eb57ac tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] 10.222.0.33 "GET /compute/v2.1/servers/1e3ca3fe-e03a-47e3-9d9c-a6ab431e2dd7" status: 200 len: 1332 microversion: 2.1 time: 0.296718 Jul 18 10:32:23.059229 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 237/474] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:32:22 2022] GET /compute/v2.1/servers/1e3ca3fe-e03a-47e3-9d9c-a6ab431e2dd7 => generated 1332 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:32:24.068838 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-6da0ebbe-eefa-446b-89f0-7c6502717611 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:32:24.069560 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-6da0ebbe-eefa-446b-89f0-7c6502717611 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] [instance: 1e3ca3fe-e03a-47e3-9d9c-a6ab431e2dd7] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:32:24.076760 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-6da0ebbe-eefa-446b-89f0-7c6502717611 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:32:24.077210 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-6da0ebbe-eefa-446b-89f0-7c6502717611 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:32:24.077988 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-6da0ebbe-eefa-446b-89f0-7c6502717611 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:32:24.078503 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-6da0ebbe-eefa-446b-89f0-7c6502717611 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:32:24.084469 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG dbcounter [-] [117879] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=117879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:32:24.118087 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-6da0ebbe-eefa-446b-89f0-7c6502717611 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:32:24.118833 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-6da0ebbe-eefa-446b-89f0-7c6502717611 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:32:24.118977 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.objects.instance [None req-6da0ebbe-eefa-446b-89f0-7c6502717611 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lazy-loading 'fault' on Instance uuid 1e3ca3fe-e03a-47e3-9d9c-a6ab431e2dd7 {{(pid=117879) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 10:32:24.167651 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-6da0ebbe-eefa-446b-89f0-7c6502717611 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f25c72896a2d4d619e5ad4b5a0a79aa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cf3d5bfe9a745f38372c42c9cfa1f63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:32:24.181527 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-6da0ebbe-eefa-446b-89f0-7c6502717611 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] 10.222.0.33 "GET /compute/v2.1/servers/1e3ca3fe-e03a-47e3-9d9c-a6ab431e2dd7" status: 200 len: 1332 microversion: 2.1 time: 0.118545 Jul 18 10:32:24.182429 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 238/475] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:32:24 2022] GET /compute/v2.1/servers/1e3ca3fe-e03a-47e3-9d9c-a6ab431e2dd7 => generated 1332 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:32:24.657515 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-833fa6d6-c4ac-4ffc-8621-98418cb9d9bb tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:32:24.658108 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-833fa6d6-c4ac-4ffc-8621-98418cb9d9bb tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] [instance: dcb1b50b-9e62-4ff3-9875-3d4635597b45] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:32:24.674743 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-833fa6d6-c4ac-4ffc-8621-98418cb9d9bb tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:32:24.675848 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-833fa6d6-c4ac-4ffc-8621-98418cb9d9bb tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:32:24.677006 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-833fa6d6-c4ac-4ffc-8621-98418cb9d9bb tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:32:24.677682 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-833fa6d6-c4ac-4ffc-8621-98418cb9d9bb tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:32:24.791740 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.objects.instance [None req-833fa6d6-c4ac-4ffc-8621-98418cb9d9bb tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lazy-loading 'services' on Instance uuid dcb1b50b-9e62-4ff3-9875-3d4635597b45 {{(pid=117880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 10:32:24.887719 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-833fa6d6-c4ac-4ffc-8621-98418cb9d9bb tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] 10.222.0.33 "DELETE /compute/v2.1/servers/dcb1b50b-9e62-4ff3-9875-3d4635597b45/os-volume_attachments/e3719658-555b-4733-b61e-334384f6186d" status: 202 len: 0 microversion: 2.1 time: 0.235635 Jul 18 10:32:24.890022 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 238/476] 10.222.0.33 () {58 vars in 1415 bytes} [Mon Jul 18 10:32:24 2022] DELETE /compute/v2.1/servers/dcb1b50b-9e62-4ff3-9875-3d4635597b45/os-volume_attachments/e3719658-555b-4733-b61e-334384f6186d => generated 0 bytes in 239 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 10:32:25.198192 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-2cb16186-53c8-48b6-a972-70a510e0b17a tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:32:25.199059 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-2cb16186-53c8-48b6-a972-70a510e0b17a tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] [instance: 1e3ca3fe-e03a-47e3-9d9c-a6ab431e2dd7] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:32:25.208243 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-2cb16186-53c8-48b6-a972-70a510e0b17a tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:32:25.208891 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-2cb16186-53c8-48b6-a972-70a510e0b17a tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:32:25.209681 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-2cb16186-53c8-48b6-a972-70a510e0b17a tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:32:25.210122 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-2cb16186-53c8-48b6-a972-70a510e0b17a tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:32:25.227472 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.wsgi [None req-2cb16186-53c8-48b6-a972-70a510e0b17a tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] HTTP exception thrown: Instance 1e3ca3fe-e03a-47e3-9d9c-a6ab431e2dd7 could not be found. Jul 18 10:32:25.229603 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-2cb16186-53c8-48b6-a972-70a510e0b17a tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Request method failure captured: Jul 18 10:32:25.229603 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: request: GET /compute/v2.1/servers/1e3ca3fe-e03a-47e3-9d9c-a6ab431e2dd7 HTTP/1.1 Jul 18 10:32:25.229603 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: Accept: application/json Jul 18 10:32:25.229603 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: Accept-Encoding: identity Jul 18 10:32:25.229603 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: Connection: close Jul 18 10:32:25.229603 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: Content-Length: 0 Jul 18 10:32:25.229603 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: Content-Type: application/json Jul 18 10:32:25.229603 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: Host: 10.222.0.33 Jul 18 10:32:25.229603 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: Openstack-System-Scope: None Jul 18 10:32:25.229603 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: User-Agent: python-urllib3/1.26.9 Jul 18 10:32:25.229603 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Auth-Token: gAAAAABi1TXs5d9KA6TlIG1Li_VNjhkDxvVxs6ByaKH91Tp5cEYBI8OTiNSNI40UEe5MBLfNqlyuYAjUMpiV_qMg9jtmq9fJwxP3wvSLbrM9kN7Z4diK5bpD5WWlO_9PNIu02mzK2QxOqaTdn-MDBEh-IwIUUSwgtjyQOUrIhUK0fhFwotym42k Jul 18 10:32:25.229603 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Domain-Id: None Jul 18 10:32:25.229603 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Domain-Name: None Jul 18 10:32:25.229603 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Identity-Status: Confirmed Jul 18 10:32:25.229603 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Is-Admin-Project: True Jul 18 10:32:25.229603 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Project-Domain-Id: default Jul 18 10:32:25.229603 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Project-Domain-Name: Default Jul 18 10:32:25.229603 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Project-Id: 1cf3d5bfe9a745f38372c42c9cfa1f63 Jul 18 10:32:25.229603 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Project-Name: tempest-AttachVolumeNegativeTest-653274830 Jul 18 10:32:25.229603 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Role: member,reader Jul 18 10:32:25.229603 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Roles: member,reader Jul 18 10:32:25.230843 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1cf3d5bfe9a745f38372c42c9cfa1f63"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1cf3d5bfe9a745f38372c42c9cfa1f63"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/1cf3d5bfe9a745f38372c42c9cfa1f63"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_1cf3d5bfe9a745f38372c42c9cfa1f63"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jul 18 10:32:25.230843 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Tenant: tempest-AttachVolumeNegativeTest-653274830 Jul 18 10:32:25.230843 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Tenant-Id: 1cf3d5bfe9a745f38372c42c9cfa1f63 Jul 18 10:32:25.230843 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-653274830 Jul 18 10:32:25.230843 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-User: tempest-AttachVolumeNegativeTest-653274830-project Jul 18 10:32:25.230843 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-User-Domain-Id: default Jul 18 10:32:25.230843 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-User-Domain-Name: Default Jul 18 10:32:25.230843 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-User-Id: f25c72896a2d4d619e5ad4b5a0a79aa6 Jul 18 10:32:25.230843 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-User-Name: tempest-AttachVolumeNegativeTest-653274830-project Jul 18 10:32:25.230843 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: method: > Jul 18 10:32:25.230843 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: exception: Instance 1e3ca3fe-e03a-47e3-9d9c-a6ab431e2dd7 could not be found. Jul 18 10:32:25.230843 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: action_args: {'id': '1e3ca3fe-e03a-47e3-9d9c-a6ab431e2dd7'} Jul 18 10:32:25.231583 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 10:32:25.231583 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:32:25.231583 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 10:32:25.231583 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 10:32:25.231583 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 10:32:25.231583 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 10:32:25.231583 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 10:32:25.231583 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 10:32:25.231583 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 10:32:25.231583 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 10:32:25.231583 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1e3ca3fe-e03a-47e3-9d9c-a6ab431e2dd7 could not be found. Jul 18 10:32:25.231583 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi Jul 18 10:32:25.231583 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:32:25.231583 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi Jul 18 10:32:25.231583 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:32:25.231583 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:32:25.231583 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:32:25.231583 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 10:32:25.231583 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 10:32:25.231583 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 10:32:25.232771 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 10:32:25.232771 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 10:32:25.232771 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 10:32:25.232771 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 10:32:25.232771 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 10:32:25.232771 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 10:32:25.232771 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 10:32:25.232771 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1e3ca3fe-e03a-47e3-9d9c-a6ab431e2dd7 could not be found. Jul 18 10:32:25.232771 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi Jul 18 10:32:25.232771 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:32:25.232771 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi Jul 18 10:32:25.232771 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:32:25.232771 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:32:25.232771 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:32:25.232771 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 10:32:25.232771 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 10:32:25.232771 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1e3ca3fe-e03a-47e3-9d9c-a6ab431e2dd7 could not be found. Jul 18 10:32:25.232771 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi Jul 18 10:32:25.235673 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-2cb16186-53c8-48b6-a972-70a510e0b17a tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Returning 404 to user: Instance 1e3ca3fe-e03a-47e3-9d9c-a6ab431e2dd7 could not be found. {{(pid=117879) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 10:32:25.235673 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-2cb16186-53c8-48b6-a972-70a510e0b17a tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] 10.222.0.33 "GET /compute/v2.1/servers/1e3ca3fe-e03a-47e3-9d9c-a6ab431e2dd7" status: 404 len: 111 microversion: 2.1 time: 0.037449 Jul 18 10:32:25.235673 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 239/477] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:32:25 2022] GET /compute/v2.1/servers/1e3ca3fe-e03a-47e3-9d9c-a6ab431e2dd7 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 18 10:32:25.243540 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-6860f8af-be2d-4018-9301-a9b598bfc4a7 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Calling method '.version_select at 0x7f9f4a219b80>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:32:25.273793 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-6860f8af-be2d-4018-9301-a9b598bfc4a7 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1607051564" status: 202 len: 0 microversion: 2.1 time: 0.035086 Jul 18 10:32:25.274296 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 239/478] 10.222.0.33 () {58 vars in 1220 bytes} [Mon Jul 18 10:32:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1607051564 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 10:32:26.206305 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-33e7f541-66b6-4020-8c71-93f7f0264156 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:32:26.206788 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-33e7f541-66b6-4020-8c71-93f7f0264156 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] [instance: db62c05e-28a8-4121-a6e5-8abb802f7a17] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:32:26.216365 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-33e7f541-66b6-4020-8c71-93f7f0264156 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:32:26.217183 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-33e7f541-66b6-4020-8c71-93f7f0264156 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:32:26.217782 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-33e7f541-66b6-4020-8c71-93f7f0264156 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:32:26.219927 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-33e7f541-66b6-4020-8c71-93f7f0264156 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:32:26.411372 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.objects.instance [None req-33e7f541-66b6-4020-8c71-93f7f0264156 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lazy-loading 'services' on Instance uuid db62c05e-28a8-4121-a6e5-8abb802f7a17 {{(pid=117879) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 10:32:26.563729 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-33e7f541-66b6-4020-8c71-93f7f0264156 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] 10.222.0.33 "DELETE /compute/v2.1/servers/db62c05e-28a8-4121-a6e5-8abb802f7a17/os-volume_attachments/a7283353-c48b-45f2-9b6f-aede9fbb96b4" status: 202 len: 0 microversion: 2.1 time: 0.361206 Jul 18 10:32:26.564492 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 240/479] 10.222.0.33 () {58 vars in 1415 bytes} [Mon Jul 18 10:32:26 2022] DELETE /compute/v2.1/servers/db62c05e-28a8-4121-a6e5-8abb802f7a17/os-volume_attachments/a7283353-c48b-45f2-9b6f-aede9fbb96b4 => generated 0 bytes in 363 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 10:32:26.573912 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-7d4a7d45-e8c8-492f-a160-b11aab506d06 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:32:26.575628 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-7d4a7d45-e8c8-492f-a160-b11aab506d06 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] [instance: db62c05e-28a8-4121-a6e5-8abb802f7a17] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:32:26.583001 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-7d4a7d45-e8c8-492f-a160-b11aab506d06 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:32:26.583308 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-7d4a7d45-e8c8-492f-a160-b11aab506d06 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:32:26.584074 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-7d4a7d45-e8c8-492f-a160-b11aab506d06 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:32:26.584846 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-7d4a7d45-e8c8-492f-a160-b11aab506d06 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:32:26.617897 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-7d4a7d45-e8c8-492f-a160-b11aab506d06 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] 10.222.0.33 "GET /compute/v2.1/servers/db62c05e-28a8-4121-a6e5-8abb802f7a17/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048618 Jul 18 10:32:26.619155 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 240/480] 10.222.0.33 () {58 vars in 1301 bytes} [Mon Jul 18 10:32:26 2022] GET /compute/v2.1/servers/db62c05e-28a8-4121-a6e5-8abb802f7a17/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 10:32:27.630914 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-a46a4111-e092-43ef-bde5-a9ca9c78eb9e tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:32:27.632124 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-a46a4111-e092-43ef-bde5-a9ca9c78eb9e tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] [instance: db62c05e-28a8-4121-a6e5-8abb802f7a17] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:32:27.639956 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-a46a4111-e092-43ef-bde5-a9ca9c78eb9e tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:32:27.640413 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-a46a4111-e092-43ef-bde5-a9ca9c78eb9e tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:32:27.641733 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-a46a4111-e092-43ef-bde5-a9ca9c78eb9e tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:32:27.642174 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-a46a4111-e092-43ef-bde5-a9ca9c78eb9e tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:32:27.673736 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-a46a4111-e092-43ef-bde5-a9ca9c78eb9e tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] 10.222.0.33 "GET /compute/v2.1/servers/db62c05e-28a8-4121-a6e5-8abb802f7a17/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047421 Jul 18 10:32:27.674326 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 241/481] 10.222.0.33 () {58 vars in 1301 bytes} [Mon Jul 18 10:32:27 2022] GET /compute/v2.1/servers/db62c05e-28a8-4121-a6e5-8abb802f7a17/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:32:28.685501 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-4c8a0751-6934-4be7-9cef-75f36e09e4bf tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:32:28.686754 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-4c8a0751-6934-4be7-9cef-75f36e09e4bf tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] [instance: db62c05e-28a8-4121-a6e5-8abb802f7a17] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:32:28.700801 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-4c8a0751-6934-4be7-9cef-75f36e09e4bf tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:32:28.701242 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-4c8a0751-6934-4be7-9cef-75f36e09e4bf tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:32:28.702043 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-4c8a0751-6934-4be7-9cef-75f36e09e4bf tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:32:28.702543 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-4c8a0751-6934-4be7-9cef-75f36e09e4bf tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:32:28.739743 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-4c8a0751-6934-4be7-9cef-75f36e09e4bf tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] 10.222.0.33 "GET /compute/v2.1/servers/db62c05e-28a8-4121-a6e5-8abb802f7a17/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054074 Jul 18 10:32:28.740601 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 241/482] 10.222.0.33 () {58 vars in 1301 bytes} [Mon Jul 18 10:32:28 2022] GET /compute/v2.1/servers/db62c05e-28a8-4121-a6e5-8abb802f7a17/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:32:29.752497 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-52c37a18-d8a0-40ef-a3b6-52c3d56fa5bf tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:32:29.753485 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-52c37a18-d8a0-40ef-a3b6-52c3d56fa5bf tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] [instance: db62c05e-28a8-4121-a6e5-8abb802f7a17] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:32:29.759474 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-52c37a18-d8a0-40ef-a3b6-52c3d56fa5bf tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:32:29.760106 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-52c37a18-d8a0-40ef-a3b6-52c3d56fa5bf tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:32:29.761161 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-52c37a18-d8a0-40ef-a3b6-52c3d56fa5bf tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:32:29.761754 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-52c37a18-d8a0-40ef-a3b6-52c3d56fa5bf tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:32:29.793159 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-52c37a18-d8a0-40ef-a3b6-52c3d56fa5bf tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] 10.222.0.33 "GET /compute/v2.1/servers/db62c05e-28a8-4121-a6e5-8abb802f7a17/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045557 Jul 18 10:32:29.794330 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 242/483] 10.222.0.33 () {58 vars in 1301 bytes} [Mon Jul 18 10:32:29 2022] GET /compute/v2.1/servers/db62c05e-28a8-4121-a6e5-8abb802f7a17/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:32:30.806118 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-f1409aac-3aba-4e99-b264-5d5798e556e3 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:32:30.807904 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-f1409aac-3aba-4e99-b264-5d5798e556e3 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] [instance: db62c05e-28a8-4121-a6e5-8abb802f7a17] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:32:30.817264 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG dbcounter [-] [117880] Writing DB stats nova_cell0:SELECT=2 {{(pid=117880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:32:30.835932 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-f1409aac-3aba-4e99-b264-5d5798e556e3 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:32:30.841453 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-f1409aac-3aba-4e99-b264-5d5798e556e3 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:32:30.842969 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-f1409aac-3aba-4e99-b264-5d5798e556e3 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:32:30.843405 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-f1409aac-3aba-4e99-b264-5d5798e556e3 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:32:30.895229 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG dbcounter [-] [117880] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=117880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:32:30.921367 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-f1409aac-3aba-4e99-b264-5d5798e556e3 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] 10.222.0.33 "GET /compute/v2.1/servers/db62c05e-28a8-4121-a6e5-8abb802f7a17/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.119608 Jul 18 10:32:30.934646 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 242/484] 10.222.0.33 () {58 vars in 1301 bytes} [Mon Jul 18 10:32:30 2022] GET /compute/v2.1/servers/db62c05e-28a8-4121-a6e5-8abb802f7a17/os-volume_attachments => generated 197 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:32:31.236461 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-b1d0ee6c-e9dc-4400-83dd-6900d81971d3 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:32:31.238323 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-b1d0ee6c-e9dc-4400-83dd-6900d81971d3 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] [instance: a3dbac58-662d-4720-8bcf-2300f9a9a5d1] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:32:31.245855 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-b1d0ee6c-e9dc-4400-83dd-6900d81971d3 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:32:31.246330 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-b1d0ee6c-e9dc-4400-83dd-6900d81971d3 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:32:31.247113 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-b1d0ee6c-e9dc-4400-83dd-6900d81971d3 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:32:31.247557 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-b1d0ee6c-e9dc-4400-83dd-6900d81971d3 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:32:31.272306 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.objects.instance [None req-b1d0ee6c-e9dc-4400-83dd-6900d81971d3 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lazy-loading 'flavor' on Instance uuid a3dbac58-662d-4720-8bcf-2300f9a9a5d1 {{(pid=117879) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 10:32:31.510611 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-b1d0ee6c-e9dc-4400-83dd-6900d81971d3 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] 10.222.0.33 "POST /compute/v2.1/servers/a3dbac58-662d-4720-8bcf-2300f9a9a5d1/action" status: 200 len: 32 microversion: 2.1 time: 0.280870 Jul 18 10:32:31.511299 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 243/485] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Jul 18 10:32:31 2022] POST /compute/v2.1/servers/a3dbac58-662d-4720-8bcf-2300f9a9a5d1/action => generated 32 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 10:32:31.521789 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-46e4242b-f315-4024-be83-d757237df246 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:32:31.522663 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-46e4242b-f315-4024-be83-d757237df246 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] [instance: a3dbac58-662d-4720-8bcf-2300f9a9a5d1] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:32:31.530330 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-46e4242b-f315-4024-be83-d757237df246 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:32:31.531168 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-46e4242b-f315-4024-be83-d757237df246 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:32:31.533126 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-46e4242b-f315-4024-be83-d757237df246 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:32:31.533850 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-46e4242b-f315-4024-be83-d757237df246 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:32:31.946927 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-9cfbc98b-7381-4562-9203-f6b261757524 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:32:31.948324 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-9cfbc98b-7381-4562-9203-f6b261757524 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] [instance: db62c05e-28a8-4121-a6e5-8abb802f7a17] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:32:31.976953 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-9cfbc98b-7381-4562-9203-f6b261757524 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:32:31.977605 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-9cfbc98b-7381-4562-9203-f6b261757524 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:32:31.979030 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-9cfbc98b-7381-4562-9203-f6b261757524 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:32:31.979689 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-9cfbc98b-7381-4562-9203-f6b261757524 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:32:32.030640 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-9cfbc98b-7381-4562-9203-f6b261757524 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] 10.222.0.33 "GET /compute/v2.1/servers/db62c05e-28a8-4121-a6e5-8abb802f7a17/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.088981 Jul 18 10:32:32.032205 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 244/486] 10.222.0.33 () {58 vars in 1301 bytes} [Mon Jul 18 10:32:31 2022] GET /compute/v2.1/servers/db62c05e-28a8-4121-a6e5-8abb802f7a17/os-volume_attachments => generated 197 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:32:32.082386 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-46e4242b-f315-4024-be83-d757237df246 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a431c9708f4694bc0d514133e76088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a1921237622439bab89676e11477c13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:32:32.097642 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-46e4242b-f315-4024-be83-d757237df246 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] 10.222.0.33 "GET /compute/v2.1/servers/a3dbac58-662d-4720-8bcf-2300f9a9a5d1" status: 200 len: 1735 microversion: 2.1 time: 0.579704 Jul 18 10:32:32.098903 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 243/487] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:32:31 2022] GET /compute/v2.1/servers/a3dbac58-662d-4720-8bcf-2300f9a9a5d1 => generated 1735 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:32:33.024265 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-31e6e12d-a924-4dc4-8957-f36de26303f2 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Action: 'create', calling method: .version_select at 0x7f9f4a12e0d0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-986614198", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLtlc7vdKxj9cZNaeJf0M1iCrKDJNDvF9NmQvy1HF9j9BcvHQNqzF1Y6YneQCUT7pl+ypQun1/tOSeV0B6pJ0zxEnuUzVUFqJABjXXBf3ih/t9Ado8/zaRQMreXCU1c6bQ=="}} {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:32:33.043846 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-a66cf130-137b-4f77-babe-22614be6ddda tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:32:33.045357 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-a66cf130-137b-4f77-babe-22614be6ddda tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] [instance: db62c05e-28a8-4121-a6e5-8abb802f7a17] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:32:33.046683 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.quota [None req-31e6e12d-a924-4dc4-8957-f36de26303f2 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Getting quotas for project 2c656b71bbd447cba7d11335c928dfda. Resources: {'key_pairs'} {{(pid=117879) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 10:32:33.050704 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.quota [None req-31e6e12d-a924-4dc4-8957-f36de26303f2 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Getting quotas for user 4e9eb8d188e040bca894e038955f2402 and project 2c656b71bbd447cba7d11335c928dfda. Resources: {'key_pairs'} {{(pid=117879) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 10:32:33.054778 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-a66cf130-137b-4f77-babe-22614be6ddda tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:32:33.054976 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-a66cf130-137b-4f77-babe-22614be6ddda tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:32:33.055809 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-a66cf130-137b-4f77-babe-22614be6ddda tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:32:33.056318 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-a66cf130-137b-4f77-babe-22614be6ddda tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:32:33.084065 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-31e6e12d-a924-4dc4-8957-f36de26303f2 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.244682 Jul 18 10:32:33.085375 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 245/488] 10.222.0.33 () {60 vars in 1158 bytes} [Mon Jul 18 10:32:32 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:32:33.096045 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-a66cf130-137b-4f77-babe-22614be6ddda tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] 10.222.0.33 "GET /compute/v2.1/servers/db62c05e-28a8-4121-a6e5-8abb802f7a17/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056572 Jul 18 10:32:33.100109 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 244/489] 10.222.0.33 () {58 vars in 1301 bytes} [Mon Jul 18 10:32:33 2022] GET /compute/v2.1/servers/db62c05e-28a8-4121-a6e5-8abb802f7a17/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:32:33.116989 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-bec94e92-e4a5-4cb0-9abe-4257a816ed6b tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:32:33.117811 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-bec94e92-e4a5-4cb0-9abe-4257a816ed6b tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] [instance: a3dbac58-662d-4720-8bcf-2300f9a9a5d1] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:32:33.126889 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-bec94e92-e4a5-4cb0-9abe-4257a816ed6b tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:32:33.127415 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-bec94e92-e4a5-4cb0-9abe-4257a816ed6b tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:32:33.128339 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-bec94e92-e4a5-4cb0-9abe-4257a816ed6b tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:32:33.128957 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-bec94e92-e4a5-4cb0-9abe-4257a816ed6b tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:32:33.324728 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-bec94e92-e4a5-4cb0-9abe-4257a816ed6b tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a431c9708f4694bc0d514133e76088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a1921237622439bab89676e11477c13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:32:33.334660 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-bec94e92-e4a5-4cb0-9abe-4257a816ed6b tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] 10.222.0.33 "GET /compute/v2.1/servers/a3dbac58-662d-4720-8bcf-2300f9a9a5d1" status: 200 len: 1735 microversion: 2.1 time: 0.222054 Jul 18 10:32:33.335333 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 246/490] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:32:33 2022] GET /compute/v2.1/servers/a3dbac58-662d-4720-8bcf-2300f9a9a5d1 => generated 1735 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:32:33.748341 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-fae016df-61a9-4d49-8243-c8be695072d7 tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:32:33.749185 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-fae016df-61a9-4d49-8243-c8be695072d7 tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] [instance: a6d1079b-c5d3-4062-9759-b681711cef09] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:32:33.756215 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-fae016df-61a9-4d49-8243-c8be695072d7 tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:32:33.756791 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-fae016df-61a9-4d49-8243-c8be695072d7 tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:32:33.757666 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-fae016df-61a9-4d49-8243-c8be695072d7 tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:32:33.758192 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-fae016df-61a9-4d49-8243-c8be695072d7 tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:32:33.859321 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.objects.instance [None req-fae016df-61a9-4d49-8243-c8be695072d7 tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Lazy-loading 'services' on Instance uuid a6d1079b-c5d3-4062-9759-b681711cef09 {{(pid=117880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 10:32:33.955570 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-fae016df-61a9-4d49-8243-c8be695072d7 tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] 10.222.0.33 "DELETE /compute/v2.1/servers/a6d1079b-c5d3-4062-9759-b681711cef09/os-volume_attachments/14932826-4cd7-41b3-b5ec-91c46b9dd29d" status: 202 len: 0 microversion: 2.1 time: 0.210973 Jul 18 10:32:33.956462 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 245/491] 10.222.0.33 () {58 vars in 1415 bytes} [Mon Jul 18 10:32:33 2022] DELETE /compute/v2.1/servers/a6d1079b-c5d3-4062-9759-b681711cef09/os-volume_attachments/14932826-4cd7-41b3-b5ec-91c46b9dd29d => generated 0 bytes in 213 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 10:32:34.136209 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-92d0af38-35c6-4f14-b838-c84ada7a2dcb tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:32:34.138434 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-92d0af38-35c6-4f14-b838-c84ada7a2dcb tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] [instance: db62c05e-28a8-4121-a6e5-8abb802f7a17] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:32:34.147967 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-92d0af38-35c6-4f14-b838-c84ada7a2dcb tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:32:34.148641 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-92d0af38-35c6-4f14-b838-c84ada7a2dcb tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:32:34.149659 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-92d0af38-35c6-4f14-b838-c84ada7a2dcb tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:32:34.150470 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-92d0af38-35c6-4f14-b838-c84ada7a2dcb tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:32:34.188969 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-92d0af38-35c6-4f14-b838-c84ada7a2dcb tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] 10.222.0.33 "GET /compute/v2.1/servers/db62c05e-28a8-4121-a6e5-8abb802f7a17/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.071997 Jul 18 10:32:34.189496 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 247/492] 10.222.0.33 () {58 vars in 1301 bytes} [Mon Jul 18 10:32:34 2022] GET /compute/v2.1/servers/db62c05e-28a8-4121-a6e5-8abb802f7a17/os-volume_attachments => generated 197 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:32:34.352015 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-3ef05245-5543-458e-aff2-4eaeb9299165 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:32:34.353249 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-3ef05245-5543-458e-aff2-4eaeb9299165 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] [instance: a3dbac58-662d-4720-8bcf-2300f9a9a5d1] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:32:34.361069 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-3ef05245-5543-458e-aff2-4eaeb9299165 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:32:34.361539 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-3ef05245-5543-458e-aff2-4eaeb9299165 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:32:34.362342 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-3ef05245-5543-458e-aff2-4eaeb9299165 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:32:34.362776 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-3ef05245-5543-458e-aff2-4eaeb9299165 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:32:34.504371 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-3ef05245-5543-458e-aff2-4eaeb9299165 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a431c9708f4694bc0d514133e76088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a1921237622439bab89676e11477c13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:32:34.513434 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-3ef05245-5543-458e-aff2-4eaeb9299165 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] 10.222.0.33 "GET /compute/v2.1/servers/a3dbac58-662d-4720-8bcf-2300f9a9a5d1" status: 200 len: 1735 microversion: 2.1 time: 0.165812 Jul 18 10:32:34.514317 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 246/493] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:32:34 2022] GET /compute/v2.1/servers/a3dbac58-662d-4720-8bcf-2300f9a9a5d1 => generated 1735 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:32:35.201730 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-14161daf-9f1b-49c6-a6f7-e6953777d124 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:32:35.202951 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-14161daf-9f1b-49c6-a6f7-e6953777d124 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] [instance: db62c05e-28a8-4121-a6e5-8abb802f7a17] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:32:35.215572 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-14161daf-9f1b-49c6-a6f7-e6953777d124 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:32:35.216028 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-14161daf-9f1b-49c6-a6f7-e6953777d124 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:32:35.218263 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-14161daf-9f1b-49c6-a6f7-e6953777d124 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:32:35.218747 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-14161daf-9f1b-49c6-a6f7-e6953777d124 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:32:35.252296 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-14161daf-9f1b-49c6-a6f7-e6953777d124 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] 10.222.0.33 "GET /compute/v2.1/servers/db62c05e-28a8-4121-a6e5-8abb802f7a17/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055884 Jul 18 10:32:35.252955 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 248/494] 10.222.0.33 () {58 vars in 1301 bytes} [Mon Jul 18 10:32:35 2022] GET /compute/v2.1/servers/db62c05e-28a8-4121-a6e5-8abb802f7a17/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 10:32:35.530965 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-3e8b8b79-080e-44d6-821b-3a5448bdf821 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:32:35.532146 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-3e8b8b79-080e-44d6-821b-3a5448bdf821 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] [instance: a3dbac58-662d-4720-8bcf-2300f9a9a5d1] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:32:35.534548 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG dbcounter [-] [117880] Writing DB stats nova_api:SELECT=67,nova_api:DELETE=1 {{(pid=117880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:32:35.541698 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-3e8b8b79-080e-44d6-821b-3a5448bdf821 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:32:35.542142 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-3e8b8b79-080e-44d6-821b-3a5448bdf821 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:32:35.542980 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-3e8b8b79-080e-44d6-821b-3a5448bdf821 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:32:35.543407 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-3e8b8b79-080e-44d6-821b-3a5448bdf821 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:32:35.674399 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-3e8b8b79-080e-44d6-821b-3a5448bdf821 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a431c9708f4694bc0d514133e76088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a1921237622439bab89676e11477c13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:32:35.683217 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-3e8b8b79-080e-44d6-821b-3a5448bdf821 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] 10.222.0.33 "GET /compute/v2.1/servers/a3dbac58-662d-4720-8bcf-2300f9a9a5d1" status: 200 len: 1735 microversion: 2.1 time: 0.155953 Jul 18 10:32:35.684546 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 247/495] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:32:35 2022] GET /compute/v2.1/servers/a3dbac58-662d-4720-8bcf-2300f9a9a5d1 => generated 1735 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:32:36.267212 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-b1a311f3-b0ab-48d6-81fb-27edfc792153 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:32:36.268438 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-b1a311f3-b0ab-48d6-81fb-27edfc792153 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] [instance: db62c05e-28a8-4121-a6e5-8abb802f7a17] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:32:36.279190 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-b1a311f3-b0ab-48d6-81fb-27edfc792153 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:32:36.279643 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-b1a311f3-b0ab-48d6-81fb-27edfc792153 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:32:36.280418 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-b1a311f3-b0ab-48d6-81fb-27edfc792153 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:32:36.280877 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-b1a311f3-b0ab-48d6-81fb-27edfc792153 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:32:36.331554 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-b1a311f3-b0ab-48d6-81fb-27edfc792153 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] 10.222.0.33 "GET /compute/v2.1/servers/db62c05e-28a8-4121-a6e5-8abb802f7a17/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.070879 Jul 18 10:32:36.332078 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 249/496] 10.222.0.33 () {58 vars in 1301 bytes} [Mon Jul 18 10:32:36 2022] GET /compute/v2.1/servers/db62c05e-28a8-4121-a6e5-8abb802f7a17/os-volume_attachments => generated 197 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:32:36.700830 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-f3e8251a-50dc-4683-90bf-e1edbddcfab1 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:32:36.702191 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-f3e8251a-50dc-4683-90bf-e1edbddcfab1 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] [instance: a3dbac58-662d-4720-8bcf-2300f9a9a5d1] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:32:36.711849 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-f3e8251a-50dc-4683-90bf-e1edbddcfab1 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:32:36.713404 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-f3e8251a-50dc-4683-90bf-e1edbddcfab1 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:32:36.714527 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-f3e8251a-50dc-4683-90bf-e1edbddcfab1 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:32:36.715186 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-f3e8251a-50dc-4683-90bf-e1edbddcfab1 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:32:36.890198 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-f3e8251a-50dc-4683-90bf-e1edbddcfab1 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a431c9708f4694bc0d514133e76088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a1921237622439bab89676e11477c13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:32:36.900632 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-f3e8251a-50dc-4683-90bf-e1edbddcfab1 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] 10.222.0.33 "GET /compute/v2.1/servers/a3dbac58-662d-4720-8bcf-2300f9a9a5d1" status: 200 len: 1735 microversion: 2.1 time: 0.204112 Jul 18 10:32:36.902696 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 248/497] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:32:36 2022] GET /compute/v2.1/servers/a3dbac58-662d-4720-8bcf-2300f9a9a5d1 => generated 1735 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:32:37.349663 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-fdfb5075-6e4e-4f77-8fc1-1dbefca2703e tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:32:37.356729 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-fdfb5075-6e4e-4f77-8fc1-1dbefca2703e tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] [instance: db62c05e-28a8-4121-a6e5-8abb802f7a17] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:32:37.369275 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-fdfb5075-6e4e-4f77-8fc1-1dbefca2703e tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:32:37.369747 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-fdfb5075-6e4e-4f77-8fc1-1dbefca2703e tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:32:37.370544 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-fdfb5075-6e4e-4f77-8fc1-1dbefca2703e tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:32:37.370994 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-fdfb5075-6e4e-4f77-8fc1-1dbefca2703e tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:32:37.414602 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-fdfb5075-6e4e-4f77-8fc1-1dbefca2703e tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] 10.222.0.33 "GET /compute/v2.1/servers/db62c05e-28a8-4121-a6e5-8abb802f7a17/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.075001 Jul 18 10:32:37.416412 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 250/498] 10.222.0.33 () {58 vars in 1301 bytes} [Mon Jul 18 10:32:37 2022] GET /compute/v2.1/servers/db62c05e-28a8-4121-a6e5-8abb802f7a17/os-volume_attachments => generated 197 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:32:37.521001 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-91f726ed-3113-4f90-b994-3006514f44ba tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:32:37.521841 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-91f726ed-3113-4f90-b994-3006514f44ba tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] [instance: 83b29c39-45ca-4cb3-ad7d-f7bd47bfe667] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:32:37.528062 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-91f726ed-3113-4f90-b994-3006514f44ba tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:32:37.528537 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-91f726ed-3113-4f90-b994-3006514f44ba tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:32:37.529315 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-91f726ed-3113-4f90-b994-3006514f44ba tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:32:37.529758 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-91f726ed-3113-4f90-b994-3006514f44ba tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:32:37.661621 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-91f726ed-3113-4f90-b994-3006514f44ba tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af30265de71409d876112350949a2a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f62ef510c8484995a2f31f29104f399f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:32:37.669607 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-91f726ed-3113-4f90-b994-3006514f44ba tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] 10.222.0.33 "GET /compute/v2.1/servers/83b29c39-45ca-4cb3-ad7d-f7bd47bfe667" status: 200 len: 1595 microversion: 2.1 time: 0.153419 Jul 18 10:32:37.670172 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 249/499] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:32:37 2022] GET /compute/v2.1/servers/83b29c39-45ca-4cb3-ad7d-f7bd47bfe667 => generated 1595 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:32:37.918678 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-4c1cb97a-425b-4184-b4ed-57dd2a7fef90 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:32:37.919279 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-4c1cb97a-425b-4184-b4ed-57dd2a7fef90 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] [instance: a3dbac58-662d-4720-8bcf-2300f9a9a5d1] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:32:37.925790 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-4c1cb97a-425b-4184-b4ed-57dd2a7fef90 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:32:37.926235 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-4c1cb97a-425b-4184-b4ed-57dd2a7fef90 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:32:37.926992 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-4c1cb97a-425b-4184-b4ed-57dd2a7fef90 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:32:37.927432 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-4c1cb97a-425b-4184-b4ed-57dd2a7fef90 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:32:38.063263 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-4c1cb97a-425b-4184-b4ed-57dd2a7fef90 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a431c9708f4694bc0d514133e76088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a1921237622439bab89676e11477c13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:32:38.073159 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-4c1cb97a-425b-4184-b4ed-57dd2a7fef90 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] 10.222.0.33 "GET /compute/v2.1/servers/a3dbac58-662d-4720-8bcf-2300f9a9a5d1" status: 200 len: 1735 microversion: 2.1 time: 0.158305 Jul 18 10:32:38.074661 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 251/500] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:32:37 2022] GET /compute/v2.1/servers/a3dbac58-662d-4720-8bcf-2300f9a9a5d1 => generated 1735 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:32:38.134298 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-d4d56b50-68ad-4abc-a737-4acf516ffed7 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:32:38.143096 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-d4d56b50-68ad-4abc-a737-4acf516ffed7 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:32:38.143549 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-d4d56b50-68ad-4abc-a737-4acf516ffed7 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:32:38.171885 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-d4d56b50-68ad-4abc-a737-4acf516ffed7 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] [instance: dcb1b50b-9e62-4ff3-9875-3d4635597b45] Going to try to stop instance {{(pid=117880) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 18 10:32:38.225523 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-d4d56b50-68ad-4abc-a737-4acf516ffed7 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] 10.222.0.33 "POST /compute/v2.1/servers/dcb1b50b-9e62-4ff3-9875-3d4635597b45/action" status: 202 len: 0 microversion: 2.1 time: 0.094943 Jul 18 10:32:38.226213 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 250/501] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Jul 18 10:32:38 2022] POST /compute/v2.1/servers/dcb1b50b-9e62-4ff3-9875-3d4635597b45/action => generated 0 bytes in 97 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 10:32:38.238094 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-d4538d00-71bb-4250-890e-86559e1aaf2e tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:32:38.238990 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-d4538d00-71bb-4250-890e-86559e1aaf2e tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] [instance: dcb1b50b-9e62-4ff3-9875-3d4635597b45] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:32:38.260176 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-d4538d00-71bb-4250-890e-86559e1aaf2e tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:32:38.260665 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-d4538d00-71bb-4250-890e-86559e1aaf2e tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:32:38.261454 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-d4538d00-71bb-4250-890e-86559e1aaf2e tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:32:38.261893 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-d4538d00-71bb-4250-890e-86559e1aaf2e tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:32:38.417161 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-d4538d00-71bb-4250-890e-86559e1aaf2e tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '986f90dfbad14324b3fffbd790d60a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e487deb7ff45bdbf2cc002d42d12a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:32:38.425539 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-d4538d00-71bb-4250-890e-86559e1aaf2e tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] 10.222.0.33 "GET /compute/v2.1/servers/dcb1b50b-9e62-4ff3-9875-3d4635597b45" status: 200 len: 1675 microversion: 2.1 time: 0.194174 Jul 18 10:32:38.426336 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 252/502] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:32:38 2022] GET /compute/v2.1/servers/dcb1b50b-9e62-4ff3-9875-3d4635597b45 => generated 1675 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:32:38.427546 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-5c9d8796-ca41-4a98-b479-4b79f8ea25de tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:32:38.428762 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-5c9d8796-ca41-4a98-b479-4b79f8ea25de tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] [instance: db62c05e-28a8-4121-a6e5-8abb802f7a17] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:32:38.435196 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-5c9d8796-ca41-4a98-b479-4b79f8ea25de tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:32:38.435666 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-5c9d8796-ca41-4a98-b479-4b79f8ea25de tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:32:38.436456 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-5c9d8796-ca41-4a98-b479-4b79f8ea25de tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:32:38.436951 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-5c9d8796-ca41-4a98-b479-4b79f8ea25de tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:32:38.469526 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-5c9d8796-ca41-4a98-b479-4b79f8ea25de tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] 10.222.0.33 "GET /compute/v2.1/servers/db62c05e-28a8-4121-a6e5-8abb802f7a17/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046940 Jul 18 10:32:38.470451 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 251/503] 10.222.0.33 () {58 vars in 1301 bytes} [Mon Jul 18 10:32:38 2022] GET /compute/v2.1/servers/db62c05e-28a8-4121-a6e5-8abb802f7a17/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 10:32:39.093775 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-fb45bcd2-2b00-429c-a156-54448530c982 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:32:39.094406 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-fb45bcd2-2b00-429c-a156-54448530c982 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] [instance: a3dbac58-662d-4720-8bcf-2300f9a9a5d1] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:32:39.103229 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-fb45bcd2-2b00-429c-a156-54448530c982 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:32:39.104009 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-fb45bcd2-2b00-429c-a156-54448530c982 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:32:39.104867 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-fb45bcd2-2b00-429c-a156-54448530c982 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:32:39.105308 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-fb45bcd2-2b00-429c-a156-54448530c982 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:32:39.132964 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG dbcounter [-] [117879] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=117879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:32:39.260542 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-fb45bcd2-2b00-429c-a156-54448530c982 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a431c9708f4694bc0d514133e76088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a1921237622439bab89676e11477c13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:32:39.283863 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-fb45bcd2-2b00-429c-a156-54448530c982 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] 10.222.0.33 "GET /compute/v2.1/servers/a3dbac58-662d-4720-8bcf-2300f9a9a5d1" status: 200 len: 1735 microversion: 2.1 time: 0.193651 Jul 18 10:32:39.284809 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 253/504] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:32:39 2022] GET /compute/v2.1/servers/a3dbac58-662d-4720-8bcf-2300f9a9a5d1 => generated 1735 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:32:39.442833 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-946ebca5-de9a-47d6-a374-fa92d564c92b tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:32:39.443467 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-946ebca5-de9a-47d6-a374-fa92d564c92b tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] [instance: dcb1b50b-9e62-4ff3-9875-3d4635597b45] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:32:39.449929 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-946ebca5-de9a-47d6-a374-fa92d564c92b tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:32:39.450382 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-946ebca5-de9a-47d6-a374-fa92d564c92b tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:32:39.451153 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-946ebca5-de9a-47d6-a374-fa92d564c92b tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:32:39.453331 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-946ebca5-de9a-47d6-a374-fa92d564c92b tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:32:39.482609 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-b6a69129-f755-41b3-8f20-0156656f98be tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:32:39.485517 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-b6a69129-f755-41b3-8f20-0156656f98be tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] [instance: db62c05e-28a8-4121-a6e5-8abb802f7a17] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:32:39.494191 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-b6a69129-f755-41b3-8f20-0156656f98be tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:32:39.496630 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-b6a69129-f755-41b3-8f20-0156656f98be tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:32:39.497887 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-b6a69129-f755-41b3-8f20-0156656f98be tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:32:39.498709 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-b6a69129-f755-41b3-8f20-0156656f98be tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:32:39.533485 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-b6a69129-f755-41b3-8f20-0156656f98be tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] 10.222.0.33 "GET /compute/v2.1/servers/db62c05e-28a8-4121-a6e5-8abb802f7a17/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.055319 Jul 18 10:32:39.535101 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 254/505] 10.222.0.33 () {58 vars in 1301 bytes} [Mon Jul 18 10:32:39 2022] GET /compute/v2.1/servers/db62c05e-28a8-4121-a6e5-8abb802f7a17/os-volume_attachments => generated 25 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 18 10:32:39.609950 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-946ebca5-de9a-47d6-a374-fa92d564c92b tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '986f90dfbad14324b3fffbd790d60a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e487deb7ff45bdbf2cc002d42d12a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:32:39.624241 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-946ebca5-de9a-47d6-a374-fa92d564c92b tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] 10.222.0.33 "GET /compute/v2.1/servers/dcb1b50b-9e62-4ff3-9875-3d4635597b45" status: 200 len: 1675 microversion: 2.1 time: 0.185091 Jul 18 10:32:39.625141 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 252/506] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:32:39 2022] GET /compute/v2.1/servers/dcb1b50b-9e62-4ff3-9875-3d4635597b45 => generated 1675 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:32:39.625431 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-6d7c5716-a97a-41ff-ae66-82c24c3d0a02 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:32:39.625990 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-6d7c5716-a97a-41ff-ae66-82c24c3d0a02 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] [instance: db62c05e-28a8-4121-a6e5-8abb802f7a17] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:32:39.636255 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-6d7c5716-a97a-41ff-ae66-82c24c3d0a02 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:32:39.636823 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-6d7c5716-a97a-41ff-ae66-82c24c3d0a02 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:32:39.637671 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-6d7c5716-a97a-41ff-ae66-82c24c3d0a02 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:32:39.638391 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-6d7c5716-a97a-41ff-ae66-82c24c3d0a02 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:32:39.666580 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-6d7c5716-a97a-41ff-ae66-82c24c3d0a02 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] [instance: db62c05e-28a8-4121-a6e5-8abb802f7a17] Going to try to terminate instance {{(pid=117879) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 10:32:39.752809 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-6d7c5716-a97a-41ff-ae66-82c24c3d0a02 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] 10.222.0.33 "DELETE /compute/v2.1/servers/db62c05e-28a8-4121-a6e5-8abb802f7a17" status: 204 len: 0 microversion: 2.1 time: 0.131168 Jul 18 10:32:39.753541 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 255/507] 10.222.0.33 () {58 vars in 1238 bytes} [Mon Jul 18 10:32:39 2022] DELETE /compute/v2.1/servers/db62c05e-28a8-4121-a6e5-8abb802f7a17 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 10:32:39.762624 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-003dcc7c-9a20-4bbb-932b-6f686f0f9857 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:32:39.763384 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-003dcc7c-9a20-4bbb-932b-6f686f0f9857 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] [instance: db62c05e-28a8-4121-a6e5-8abb802f7a17] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:32:39.770587 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-003dcc7c-9a20-4bbb-932b-6f686f0f9857 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:32:39.771227 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-003dcc7c-9a20-4bbb-932b-6f686f0f9857 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:32:39.771937 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-003dcc7c-9a20-4bbb-932b-6f686f0f9857 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:32:39.772634 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-003dcc7c-9a20-4bbb-932b-6f686f0f9857 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:32:39.818384 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [req-e9274039-900a-44c3-8c14-8ea0b7790738 req-f5e71732-b9a6-4145-b7aa-e5ffe3597fe9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "83b29c39-45ca-4cb3-ad7d-f7bd47bfe667", "tag": "8763c93e-265a-48e3-9444-a3c09c88377b"}]} {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:32:39.829271 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [req-e9274039-900a-44c3-8c14-8ea0b7790738 req-f5e71732-b9a6-4145-b7aa-e5ffe3597fe9 service nova] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:32:39.830362 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [req-e9274039-900a-44c3-8c14-8ea0b7790738 req-f5e71732-b9a6-4145-b7aa-e5ffe3597fe9 service nova] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:32:39.846958 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.compute.server_external_events [req-e9274039-900a-44c3-8c14-8ea0b7790738 req-f5e71732-b9a6-4145-b7aa-e5ffe3597fe9 service nova] Creating event network-changed:8763c93e-265a-48e3-9444-a3c09c88377b for instance 83b29c39-45ca-4cb3-ad7d-f7bd47bfe667 on hv-cinder-83754 Jul 18 10:32:39.857075 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [req-e9274039-900a-44c3-8c14-8ea0b7790738 req-f5e71732-b9a6-4145-b7aa-e5ffe3597fe9 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042515 Jul 18 10:32:39.857966 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 256/508] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jul 18 10:32:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 10:32:39.936403 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-003dcc7c-9a20-4bbb-932b-6f686f0f9857 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f25c72896a2d4d619e5ad4b5a0a79aa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cf3d5bfe9a745f38372c42c9cfa1f63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:32:39.947682 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-003dcc7c-9a20-4bbb-932b-6f686f0f9857 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] 10.222.0.33 "GET /compute/v2.1/servers/db62c05e-28a8-4121-a6e5-8abb802f7a17" status: 200 len: 1682 microversion: 2.1 time: 0.189047 Jul 18 10:32:39.961242 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 253/509] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:32:39 2022] GET /compute/v2.1/servers/db62c05e-28a8-4121-a6e5-8abb802f7a17 => generated 1682 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:32:40.306768 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-b91290f2-2054-43e0-894a-80fd8ebd1275 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:32:40.307885 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-b91290f2-2054-43e0-894a-80fd8ebd1275 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] [instance: a3dbac58-662d-4720-8bcf-2300f9a9a5d1] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:32:40.314863 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-b91290f2-2054-43e0-894a-80fd8ebd1275 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:32:40.315549 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-b91290f2-2054-43e0-894a-80fd8ebd1275 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:32:40.316358 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-b91290f2-2054-43e0-894a-80fd8ebd1275 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:32:40.316817 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-b91290f2-2054-43e0-894a-80fd8ebd1275 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:32:40.439649 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-f483318d-c6bf-4db1-aa92-7e4a39ad98cb tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:32:40.441126 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-f483318d-c6bf-4db1-aa92-7e4a39ad98cb tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] [instance: a6d1079b-c5d3-4062-9759-b681711cef09] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:32:40.448916 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-f483318d-c6bf-4db1-aa92-7e4a39ad98cb tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:32:40.450021 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-f483318d-c6bf-4db1-aa92-7e4a39ad98cb tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:32:40.450960 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-f483318d-c6bf-4db1-aa92-7e4a39ad98cb tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:32:40.451384 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-f483318d-c6bf-4db1-aa92-7e4a39ad98cb tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:32:40.486631 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-f483318d-c6bf-4db1-aa92-7e4a39ad98cb tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] [instance: a6d1079b-c5d3-4062-9759-b681711cef09] Going to try to terminate instance {{(pid=117880) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 10:32:40.487683 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-b91290f2-2054-43e0-894a-80fd8ebd1275 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a431c9708f4694bc0d514133e76088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a1921237622439bab89676e11477c13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:32:40.497945 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-b91290f2-2054-43e0-894a-80fd8ebd1275 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] 10.222.0.33 "GET /compute/v2.1/servers/a3dbac58-662d-4720-8bcf-2300f9a9a5d1" status: 200 len: 1735 microversion: 2.1 time: 0.199274 Jul 18 10:32:40.498531 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 257/510] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:32:40 2022] GET /compute/v2.1/servers/a3dbac58-662d-4720-8bcf-2300f9a9a5d1 => generated 1735 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:32:40.588415 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-f483318d-c6bf-4db1-aa92-7e4a39ad98cb tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] 10.222.0.33 "DELETE /compute/v2.1/servers/a6d1079b-c5d3-4062-9759-b681711cef09" status: 204 len: 0 microversion: 2.1 time: 0.152437 Jul 18 10:32:40.592544 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 254/511] 10.222.0.33 () {58 vars in 1238 bytes} [Mon Jul 18 10:32:40 2022] DELETE /compute/v2.1/servers/a6d1079b-c5d3-4062-9759-b681711cef09 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 18 10:32:40.598526 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-60ab46f1-a64f-44f6-b3bb-bc53570fd82e tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:32:40.599297 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-60ab46f1-a64f-44f6-b3bb-bc53570fd82e tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] [instance: a6d1079b-c5d3-4062-9759-b681711cef09] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:32:40.605607 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-60ab46f1-a64f-44f6-b3bb-bc53570fd82e tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:32:40.606064 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-60ab46f1-a64f-44f6-b3bb-bc53570fd82e tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:32:40.606845 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-60ab46f1-a64f-44f6-b3bb-bc53570fd82e tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:32:40.607298 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-60ab46f1-a64f-44f6-b3bb-bc53570fd82e tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:32:40.642442 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-69fac403-ffd8-4a85-aa5a-c88a0dafaa6a tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:32:40.643410 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-69fac403-ffd8-4a85-aa5a-c88a0dafaa6a tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] [instance: dcb1b50b-9e62-4ff3-9875-3d4635597b45] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:32:40.653736 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-69fac403-ffd8-4a85-aa5a-c88a0dafaa6a tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:32:40.654641 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-69fac403-ffd8-4a85-aa5a-c88a0dafaa6a tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:32:40.655703 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-69fac403-ffd8-4a85-aa5a-c88a0dafaa6a tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:32:40.656270 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-69fac403-ffd8-4a85-aa5a-c88a0dafaa6a tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:32:40.903115 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-60ab46f1-a64f-44f6-b3bb-bc53570fd82e tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c9439cb644548b8b3b5fd5c610757b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6203312784435b8cd1fdfede3fb597', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:32:40.912308 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-60ab46f1-a64f-44f6-b3bb-bc53570fd82e tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] 10.222.0.33 "GET /compute/v2.1/servers/a6d1079b-c5d3-4062-9759-b681711cef09" status: 200 len: 1514 microversion: 2.1 time: 0.317309 Jul 18 10:32:40.913282 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 258/512] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:32:40 2022] GET /compute/v2.1/servers/a6d1079b-c5d3-4062-9759-b681711cef09 => generated 1514 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:32:40.930356 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-69fac403-ffd8-4a85-aa5a-c88a0dafaa6a tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '986f90dfbad14324b3fffbd790d60a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e487deb7ff45bdbf2cc002d42d12a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:32:40.934083 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG dbcounter [-] [117880] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=117880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:32:40.939370 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-69fac403-ffd8-4a85-aa5a-c88a0dafaa6a tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] 10.222.0.33 "GET /compute/v2.1/servers/dcb1b50b-9e62-4ff3-9875-3d4635597b45" status: 200 len: 1675 microversion: 2.1 time: 0.301287 Jul 18 10:32:40.940471 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 255/513] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:32:40 2022] GET /compute/v2.1/servers/dcb1b50b-9e62-4ff3-9875-3d4635597b45 => generated 1675 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:32:40.969890 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-a007a6a3-b4ba-4fb6-a2e6-37ffd638721b tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:32:40.971329 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-a007a6a3-b4ba-4fb6-a2e6-37ffd638721b tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] [instance: db62c05e-28a8-4121-a6e5-8abb802f7a17] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:32:40.979559 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-a007a6a3-b4ba-4fb6-a2e6-37ffd638721b tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:32:40.980973 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-a007a6a3-b4ba-4fb6-a2e6-37ffd638721b tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:32:40.982212 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-a007a6a3-b4ba-4fb6-a2e6-37ffd638721b tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:32:40.982920 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-a007a6a3-b4ba-4fb6-a2e6-37ffd638721b tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:32:41.149020 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-1129cbaf-f394-434c-831a-0a90114a1bff tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-2104931263"}} {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:32:41.150040 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-1129cbaf-f394-434c-831a-0a90114a1bff tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] [instance: 83b29c39-45ca-4cb3-ad7d-f7bd47bfe667] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:32:41.157441 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-1129cbaf-f394-434c-831a-0a90114a1bff tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:32:41.158471 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-1129cbaf-f394-434c-831a-0a90114a1bff tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:32:41.159436 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-1129cbaf-f394-434c-831a-0a90114a1bff tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:32:41.161930 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-1129cbaf-f394-434c-831a-0a90114a1bff tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:32:41.175566 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-a007a6a3-b4ba-4fb6-a2e6-37ffd638721b tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f25c72896a2d4d619e5ad4b5a0a79aa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cf3d5bfe9a745f38372c42c9cfa1f63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:32:41.183471 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-a007a6a3-b4ba-4fb6-a2e6-37ffd638721b tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] 10.222.0.33 "GET /compute/v2.1/servers/db62c05e-28a8-4121-a6e5-8abb802f7a17" status: 200 len: 1682 microversion: 2.1 time: 0.220774 Jul 18 10:32:41.183974 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 259/514] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:32:40 2022] GET /compute/v2.1/servers/db62c05e-28a8-4121-a6e5-8abb802f7a17 => generated 1682 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:32:41.300800 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.network.security_group_api [None req-1129cbaf-f394-434c-831a-0a90114a1bff tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Adding security group 80b87658-1b7e-4ad8-a67e-54037b81d5ba to port 8763c93e-265a-48e3-9444-a3c09c88377b Jul 18 10:32:41.515194 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-efce08f9-5b10-42b4-bbf7-8c735555fe68 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:32:41.515716 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-efce08f9-5b10-42b4-bbf7-8c735555fe68 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] [instance: a3dbac58-662d-4720-8bcf-2300f9a9a5d1] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:32:41.522816 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-efce08f9-5b10-42b4-bbf7-8c735555fe68 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:32:41.523282 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-efce08f9-5b10-42b4-bbf7-8c735555fe68 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:32:41.524085 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-efce08f9-5b10-42b4-bbf7-8c735555fe68 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:32:41.524829 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-efce08f9-5b10-42b4-bbf7-8c735555fe68 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:32:41.927044 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-efce08f9-5b10-42b4-bbf7-8c735555fe68 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a431c9708f4694bc0d514133e76088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a1921237622439bab89676e11477c13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:32:41.937003 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-efce08f9-5b10-42b4-bbf7-8c735555fe68 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] 10.222.0.33 "GET /compute/v2.1/servers/a3dbac58-662d-4720-8bcf-2300f9a9a5d1" status: 200 len: 1735 microversion: 2.1 time: 0.425771 Jul 18 10:32:41.946577 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 260/515] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:32:41 2022] GET /compute/v2.1/servers/a3dbac58-662d-4720-8bcf-2300f9a9a5d1 => generated 1735 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:32:41.946577 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-e31e9f12-783b-4365-83a8-c776aceab801 tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:32:41.946577 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-e31e9f12-783b-4365-83a8-c776aceab801 tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] [instance: a6d1079b-c5d3-4062-9759-b681711cef09] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:32:41.949096 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-e31e9f12-783b-4365-83a8-c776aceab801 tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:32:41.949675 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-e31e9f12-783b-4365-83a8-c776aceab801 tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:32:41.950999 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-e31e9f12-783b-4365-83a8-c776aceab801 tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:32:41.956859 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-e31e9f12-783b-4365-83a8-c776aceab801 tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:32:41.974636 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-1129cbaf-f394-434c-831a-0a90114a1bff tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] 10.222.0.33 "POST /compute/v2.1/servers/83b29c39-45ca-4cb3-ad7d-f7bd47bfe667/action" status: 202 len: 0 microversion: 2.1 time: 0.829936 Jul 18 10:32:41.978702 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 256/516] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Jul 18 10:32:41 2022] POST /compute/v2.1/servers/83b29c39-45ca-4cb3-ad7d-f7bd47bfe667/action => generated 0 bytes in 835 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 10:32:41.986548 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-5c9cd360-975d-4199-80e7-ea3b340d3e52 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:32:41.987180 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-5c9cd360-975d-4199-80e7-ea3b340d3e52 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] [instance: dcb1b50b-9e62-4ff3-9875-3d4635597b45] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:32:42.003182 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-5c9cd360-975d-4199-80e7-ea3b340d3e52 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:32:42.003644 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-5c9cd360-975d-4199-80e7-ea3b340d3e52 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:32:42.004434 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-5c9cd360-975d-4199-80e7-ea3b340d3e52 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:32:42.004898 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-5c9cd360-975d-4199-80e7-ea3b340d3e52 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:32:42.229393 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-e31e9f12-783b-4365-83a8-c776aceab801 tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c9439cb644548b8b3b5fd5c610757b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6203312784435b8cd1fdfede3fb597', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:32:42.238662 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-e31e9f12-783b-4365-83a8-c776aceab801 tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] 10.222.0.33 "GET /compute/v2.1/servers/a6d1079b-c5d3-4062-9759-b681711cef09" status: 200 len: 1514 microversion: 2.1 time: 0.299937 Jul 18 10:32:42.239596 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 261/517] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:32:41 2022] GET /compute/v2.1/servers/a6d1079b-c5d3-4062-9759-b681711cef09 => generated 1514 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:32:42.244114 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-5c9cd360-975d-4199-80e7-ea3b340d3e52 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '986f90dfbad14324b3fffbd790d60a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e487deb7ff45bdbf2cc002d42d12a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:32:42.251208 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-76d683d6-0c9f-4d72-81df-f9a3dffa7897 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:32:42.252001 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-76d683d6-0c9f-4d72-81df-f9a3dffa7897 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] [instance: 83b29c39-45ca-4cb3-ad7d-f7bd47bfe667] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:32:42.257560 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-5c9cd360-975d-4199-80e7-ea3b340d3e52 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] 10.222.0.33 "GET /compute/v2.1/servers/dcb1b50b-9e62-4ff3-9875-3d4635597b45" status: 200 len: 1675 microversion: 2.1 time: 0.277747 Jul 18 10:32:42.268953 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 257/518] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:32:41 2022] GET /compute/v2.1/servers/dcb1b50b-9e62-4ff3-9875-3d4635597b45 => generated 1675 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:32:42.269247 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-76d683d6-0c9f-4d72-81df-f9a3dffa7897 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:32:42.269247 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-76d683d6-0c9f-4d72-81df-f9a3dffa7897 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:32:42.269247 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-76d683d6-0c9f-4d72-81df-f9a3dffa7897 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:32:42.269247 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-76d683d6-0c9f-4d72-81df-f9a3dffa7897 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:32:42.269566 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [req-bb48c5e9-652f-434c-8072-11fc265bff4e req-ebdc3837-56cd-4f2d-b5f3-0abce0cbb627 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "83b29c39-45ca-4cb3-ad7d-f7bd47bfe667", "tag": "8763c93e-265a-48e3-9444-a3c09c88377b"}]} {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:32:42.274532 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [req-bb48c5e9-652f-434c-8072-11fc265bff4e req-ebdc3837-56cd-4f2d-b5f3-0abce0cbb627 service nova] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:32:42.275056 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [req-bb48c5e9-652f-434c-8072-11fc265bff4e req-ebdc3837-56cd-4f2d-b5f3-0abce0cbb627 service nova] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:32:42.287996 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.compute.server_external_events [req-bb48c5e9-652f-434c-8072-11fc265bff4e req-ebdc3837-56cd-4f2d-b5f3-0abce0cbb627 service nova] Creating event network-changed:8763c93e-265a-48e3-9444-a3c09c88377b for instance 83b29c39-45ca-4cb3-ad7d-f7bd47bfe667 on hv-cinder-83754 Jul 18 10:32:42.293491 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [req-bb48c5e9-652f-434c-8072-11fc265bff4e req-ebdc3837-56cd-4f2d-b5f3-0abce0cbb627 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034114 Jul 18 10:32:42.294174 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 258/519] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jul 18 10:32:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:32:42.304838 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-2ae7bb1e-8f34-4e53-9402-4e74e901045b tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:32:42.305657 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-2ae7bb1e-8f34-4e53-9402-4e74e901045b tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] [instance: db62c05e-28a8-4121-a6e5-8abb802f7a17] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:32:42.312122 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-2ae7bb1e-8f34-4e53-9402-4e74e901045b tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:32:42.313389 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-2ae7bb1e-8f34-4e53-9402-4e74e901045b tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:32:42.314359 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-2ae7bb1e-8f34-4e53-9402-4e74e901045b tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:32:42.314888 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-2ae7bb1e-8f34-4e53-9402-4e74e901045b tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:32:42.479491 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-76d683d6-0c9f-4d72-81df-f9a3dffa7897 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af30265de71409d876112350949a2a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f62ef510c8484995a2f31f29104f399f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:32:42.489914 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-76d683d6-0c9f-4d72-81df-f9a3dffa7897 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] 10.222.0.33 "GET /compute/v2.1/servers/83b29c39-45ca-4cb3-ad7d-f7bd47bfe667" status: 200 len: 1642 microversion: 2.1 time: 0.248806 Jul 18 10:32:42.490488 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 262/520] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:32:42 2022] GET /compute/v2.1/servers/83b29c39-45ca-4cb3-ad7d-f7bd47bfe667 => generated 1642 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:32:42.502873 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-2ae7bb1e-8f34-4e53-9402-4e74e901045b tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f25c72896a2d4d619e5ad4b5a0a79aa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cf3d5bfe9a745f38372c42c9cfa1f63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:32:42.510557 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-2ae7bb1e-8f34-4e53-9402-4e74e901045b tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] 10.222.0.33 "GET /compute/v2.1/servers/db62c05e-28a8-4121-a6e5-8abb802f7a17" status: 200 len: 1682 microversion: 2.1 time: 0.212042 Jul 18 10:32:42.511125 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 259/521] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:32:42 2022] GET /compute/v2.1/servers/db62c05e-28a8-4121-a6e5-8abb802f7a17 => generated 1682 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:32:42.954039 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-ea65cce6-cc8b-4af9-b1c7-bada0c56f1a3 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:32:42.954644 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-ea65cce6-cc8b-4af9-b1c7-bada0c56f1a3 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] [instance: a3dbac58-662d-4720-8bcf-2300f9a9a5d1] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:32:42.961835 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-ea65cce6-cc8b-4af9-b1c7-bada0c56f1a3 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:32:42.962291 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-ea65cce6-cc8b-4af9-b1c7-bada0c56f1a3 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:32:42.963074 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-ea65cce6-cc8b-4af9-b1c7-bada0c56f1a3 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:32:42.963511 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-ea65cce6-cc8b-4af9-b1c7-bada0c56f1a3 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:32:43.061368 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG dbcounter [-] [117879] Writing DB stats nova_cell0:SELECT=4 {{(pid=117879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:32:43.101931 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-ea65cce6-cc8b-4af9-b1c7-bada0c56f1a3 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a431c9708f4694bc0d514133e76088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a1921237622439bab89676e11477c13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:32:43.110979 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-ea65cce6-cc8b-4af9-b1c7-bada0c56f1a3 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] 10.222.0.33 "GET /compute/v2.1/servers/a3dbac58-662d-4720-8bcf-2300f9a9a5d1" status: 200 len: 1735 microversion: 2.1 time: 0.160769 Jul 18 10:32:43.111544 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 263/522] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:32:42 2022] GET /compute/v2.1/servers/a3dbac58-662d-4720-8bcf-2300f9a9a5d1 => generated 1735 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:32:43.256570 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-be0aa6bb-c5ca-4f24-be42-02317d006880 tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:32:43.257187 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-be0aa6bb-c5ca-4f24-be42-02317d006880 tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] [instance: a6d1079b-c5d3-4062-9759-b681711cef09] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:32:43.263200 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-be0aa6bb-c5ca-4f24-be42-02317d006880 tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:32:43.263653 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-be0aa6bb-c5ca-4f24-be42-02317d006880 tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:32:43.264414 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-be0aa6bb-c5ca-4f24-be42-02317d006880 tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:32:43.264884 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-be0aa6bb-c5ca-4f24-be42-02317d006880 tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:32:43.275361 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-e6a34ffe-5ca2-4523-8e4b-e99dd63607f5 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:32:43.277945 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-e6a34ffe-5ca2-4523-8e4b-e99dd63607f5 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] [instance: dcb1b50b-9e62-4ff3-9875-3d4635597b45] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:32:43.300649 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-e6a34ffe-5ca2-4523-8e4b-e99dd63607f5 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:32:43.301113 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-e6a34ffe-5ca2-4523-8e4b-e99dd63607f5 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:32:43.301890 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-e6a34ffe-5ca2-4523-8e4b-e99dd63607f5 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:32:43.302348 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-e6a34ffe-5ca2-4523-8e4b-e99dd63607f5 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:32:43.705497 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-be0aa6bb-c5ca-4f24-be42-02317d006880 tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c9439cb644548b8b3b5fd5c610757b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6203312784435b8cd1fdfede3fb597', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:32:43.715279 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-be0aa6bb-c5ca-4f24-be42-02317d006880 tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] 10.222.0.33 "GET /compute/v2.1/servers/a6d1079b-c5d3-4062-9759-b681711cef09" status: 200 len: 1514 microversion: 2.1 time: 0.462496 Jul 18 10:32:43.715855 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 260/523] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:32:43 2022] GET /compute/v2.1/servers/a6d1079b-c5d3-4062-9759-b681711cef09 => generated 1514 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:32:43.717182 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-e6a34ffe-5ca2-4523-8e4b-e99dd63607f5 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '986f90dfbad14324b3fffbd790d60a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e487deb7ff45bdbf2cc002d42d12a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:32:43.722626 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-da6a76e3-d2bd-4832-bb60-b5fdd61ff4d5 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:32:43.723414 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-da6a76e3-d2bd-4832-bb60-b5fdd61ff4d5 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] [instance: db62c05e-28a8-4121-a6e5-8abb802f7a17] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:32:43.725092 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-e6a34ffe-5ca2-4523-8e4b-e99dd63607f5 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] 10.222.0.33 "GET /compute/v2.1/servers/dcb1b50b-9e62-4ff3-9875-3d4635597b45" status: 200 len: 1675 microversion: 2.1 time: 0.453494 Jul 18 10:32:43.738075 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 264/524] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:32:43 2022] GET /compute/v2.1/servers/dcb1b50b-9e62-4ff3-9875-3d4635597b45 => generated 1675 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:32:43.741988 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-da6a76e3-d2bd-4832-bb60-b5fdd61ff4d5 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:32:43.742433 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-da6a76e3-d2bd-4832-bb60-b5fdd61ff4d5 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:32:43.743396 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-da6a76e3-d2bd-4832-bb60-b5fdd61ff4d5 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:32:43.743825 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-da6a76e3-d2bd-4832-bb60-b5fdd61ff4d5 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:32:44.072290 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-da6a76e3-d2bd-4832-bb60-b5fdd61ff4d5 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f25c72896a2d4d619e5ad4b5a0a79aa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cf3d5bfe9a745f38372c42c9cfa1f63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:32:44.081134 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-da6a76e3-d2bd-4832-bb60-b5fdd61ff4d5 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] 10.222.0.33 "GET /compute/v2.1/servers/db62c05e-28a8-4121-a6e5-8abb802f7a17" status: 200 len: 1682 microversion: 2.1 time: 0.364112 Jul 18 10:32:44.096347 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 261/525] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:32:43 2022] GET /compute/v2.1/servers/db62c05e-28a8-4121-a6e5-8abb802f7a17 => generated 1682 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:32:44.129227 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-bae0828f-aa29-4111-a929-a1feb3f645d8 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:32:44.130071 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-bae0828f-aa29-4111-a929-a1feb3f645d8 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] [instance: a3dbac58-662d-4720-8bcf-2300f9a9a5d1] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:32:44.136537 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-bae0828f-aa29-4111-a929-a1feb3f645d8 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:32:44.137289 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-bae0828f-aa29-4111-a929-a1feb3f645d8 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:32:44.138127 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-bae0828f-aa29-4111-a929-a1feb3f645d8 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:32:44.138644 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-bae0828f-aa29-4111-a929-a1feb3f645d8 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:32:44.336171 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [req-1b3733c7-2743-4d70-8569-718335ce3236 req-6efb45cb-b0dc-4e02-bb7c-a0b9f51559e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db62c05e-28a8-4121-a6e5-8abb802f7a17", "name": "network-vif-deleted", "tag": "f97d9284-09c3-4aa3-8f54-5bb526b9fe08"}]} {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:32:44.356089 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [req-1b3733c7-2743-4d70-8569-718335ce3236 req-6efb45cb-b0dc-4e02-bb7c-a0b9f51559e7 service nova] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:32:44.357409 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [req-1b3733c7-2743-4d70-8569-718335ce3236 req-6efb45cb-b0dc-4e02-bb7c-a0b9f51559e7 service nova] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:32:44.402144 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.compute.server_external_events [req-1b3733c7-2743-4d70-8569-718335ce3236 req-6efb45cb-b0dc-4e02-bb7c-a0b9f51559e7 service nova] Creating event network-vif-deleted:f97d9284-09c3-4aa3-8f54-5bb526b9fe08 for instance db62c05e-28a8-4121-a6e5-8abb802f7a17 on hv-cinder-83754 Jul 18 10:32:44.408498 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [req-1b3733c7-2743-4d70-8569-718335ce3236 req-6efb45cb-b0dc-4e02-bb7c-a0b9f51559e7 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076630 Jul 18 10:32:44.427675 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 262/526] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jul 18 10:32:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 10:32:44.463832 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [req-ec798828-ff9b-4767-8dca-59d4ad13c8de req-17374661-cce7-40ae-9a35-7a52bebf3c38 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a6d1079b-c5d3-4062-9759-b681711cef09", "name": "network-vif-deleted", "tag": "6a2188b8-537d-4141-bb7c-a4099429ba7c"}]} {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:32:44.484711 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [req-ec798828-ff9b-4767-8dca-59d4ad13c8de req-17374661-cce7-40ae-9a35-7a52bebf3c38 service nova] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:32:44.485634 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [req-ec798828-ff9b-4767-8dca-59d4ad13c8de req-17374661-cce7-40ae-9a35-7a52bebf3c38 service nova] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:32:44.488817 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-bae0828f-aa29-4111-a929-a1feb3f645d8 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a431c9708f4694bc0d514133e76088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a1921237622439bab89676e11477c13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:32:44.503224 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-bae0828f-aa29-4111-a929-a1feb3f645d8 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] 10.222.0.33 "GET /compute/v2.1/servers/a3dbac58-662d-4720-8bcf-2300f9a9a5d1" status: 200 len: 1735 microversion: 2.1 time: 0.379573 Jul 18 10:32:44.504203 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 265/527] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:32:44 2022] GET /compute/v2.1/servers/a3dbac58-662d-4720-8bcf-2300f9a9a5d1 => generated 1735 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:32:44.530291 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.compute.server_external_events [req-ec798828-ff9b-4767-8dca-59d4ad13c8de req-17374661-cce7-40ae-9a35-7a52bebf3c38 service nova] Creating event network-vif-deleted:6a2188b8-537d-4141-bb7c-a4099429ba7c for instance a6d1079b-c5d3-4062-9759-b681711cef09 on hv-cinder-83754 Jul 18 10:32:44.544854 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [req-ec798828-ff9b-4767-8dca-59d4ad13c8de req-17374661-cce7-40ae-9a35-7a52bebf3c38 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086316 Jul 18 10:32:44.546232 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 263/528] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jul 18 10:32:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:32:44.733324 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-a3acddf3-04a0-4d67-b8f6-fd2f932e7d60 tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:32:44.734038 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-a3acddf3-04a0-4d67-b8f6-fd2f932e7d60 tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] [instance: a6d1079b-c5d3-4062-9759-b681711cef09] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:32:44.742816 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-a3acddf3-04a0-4d67-b8f6-fd2f932e7d60 tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:32:44.743273 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-a3acddf3-04a0-4d67-b8f6-fd2f932e7d60 tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:32:44.744064 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-a3acddf3-04a0-4d67-b8f6-fd2f932e7d60 tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:32:44.744495 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-a3acddf3-04a0-4d67-b8f6-fd2f932e7d60 tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:32:44.749283 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-f90caa1d-9c51-4d79-b821-0a3b0bfadf80 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:32:44.750945 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-f90caa1d-9c51-4d79-b821-0a3b0bfadf80 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] [instance: dcb1b50b-9e62-4ff3-9875-3d4635597b45] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:32:44.759505 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-f90caa1d-9c51-4d79-b821-0a3b0bfadf80 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:32:44.759955 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-f90caa1d-9c51-4d79-b821-0a3b0bfadf80 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:32:44.761185 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-f90caa1d-9c51-4d79-b821-0a3b0bfadf80 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:32:44.761911 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-f90caa1d-9c51-4d79-b821-0a3b0bfadf80 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:32:44.781255 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-a3acddf3-04a0-4d67-b8f6-fd2f932e7d60 tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:32:44.781741 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-a3acddf3-04a0-4d67-b8f6-fd2f932e7d60 tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:32:44.782206 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.objects.instance [None req-a3acddf3-04a0-4d67-b8f6-fd2f932e7d60 tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Lazy-loading 'fault' on Instance uuid a6d1079b-c5d3-4062-9759-b681711cef09 {{(pid=117879) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 10:32:44.855441 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-a3acddf3-04a0-4d67-b8f6-fd2f932e7d60 tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c9439cb644548b8b3b5fd5c610757b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6203312784435b8cd1fdfede3fb597', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:32:44.866025 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-a3acddf3-04a0-4d67-b8f6-fd2f932e7d60 tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] 10.222.0.33 "GET /compute/v2.1/servers/a6d1079b-c5d3-4062-9759-b681711cef09" status: 200 len: 1309 microversion: 2.1 time: 0.136563 Jul 18 10:32:44.866846 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 266/529] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:32:44 2022] GET /compute/v2.1/servers/a6d1079b-c5d3-4062-9759-b681711cef09 => generated 1309 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:32:45.022975 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-f90caa1d-9c51-4d79-b821-0a3b0bfadf80 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '986f90dfbad14324b3fffbd790d60a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e487deb7ff45bdbf2cc002d42d12a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:32:45.031116 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-f90caa1d-9c51-4d79-b821-0a3b0bfadf80 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] 10.222.0.33 "GET /compute/v2.1/servers/dcb1b50b-9e62-4ff3-9875-3d4635597b45" status: 200 len: 1675 microversion: 2.1 time: 0.289088 Jul 18 10:32:45.031915 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 264/530] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:32:44 2022] GET /compute/v2.1/servers/dcb1b50b-9e62-4ff3-9875-3d4635597b45 => generated 1675 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:32:45.102604 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-3d2789a6-fe48-42d5-a480-301c085358a0 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:32:45.103654 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-3d2789a6-fe48-42d5-a480-301c085358a0 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] [instance: db62c05e-28a8-4121-a6e5-8abb802f7a17] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:32:45.117370 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-3d2789a6-fe48-42d5-a480-301c085358a0 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:32:45.117827 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-3d2789a6-fe48-42d5-a480-301c085358a0 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:32:45.118672 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-3d2789a6-fe48-42d5-a480-301c085358a0 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:32:45.119193 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-3d2789a6-fe48-42d5-a480-301c085358a0 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:32:45.157324 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-3d2789a6-fe48-42d5-a480-301c085358a0 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:32:45.157873 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-3d2789a6-fe48-42d5-a480-301c085358a0 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:32:45.158316 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.objects.instance [None req-3d2789a6-fe48-42d5-a480-301c085358a0 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lazy-loading 'fault' on Instance uuid db62c05e-28a8-4121-a6e5-8abb802f7a17 {{(pid=117879) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 10:32:45.233960 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-3d2789a6-fe48-42d5-a480-301c085358a0 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f25c72896a2d4d619e5ad4b5a0a79aa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cf3d5bfe9a745f38372c42c9cfa1f63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:32:45.256414 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-3d2789a6-fe48-42d5-a480-301c085358a0 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] 10.222.0.33 "GET /compute/v2.1/servers/db62c05e-28a8-4121-a6e5-8abb802f7a17" status: 200 len: 1330 microversion: 2.1 time: 0.157927 Jul 18 10:32:45.257513 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 267/531] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:32:45 2022] GET /compute/v2.1/servers/db62c05e-28a8-4121-a6e5-8abb802f7a17 => generated 1330 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:32:45.520971 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-79a8b2fd-9701-41e5-a82c-4b24c905ec8d tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:32:45.521742 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-79a8b2fd-9701-41e5-a82c-4b24c905ec8d tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] [instance: a3dbac58-662d-4720-8bcf-2300f9a9a5d1] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:32:45.529522 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-79a8b2fd-9701-41e5-a82c-4b24c905ec8d tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:32:45.531683 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-79a8b2fd-9701-41e5-a82c-4b24c905ec8d tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:32:45.534252 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-79a8b2fd-9701-41e5-a82c-4b24c905ec8d tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:32:45.535143 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-79a8b2fd-9701-41e5-a82c-4b24c905ec8d tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:32:45.740691 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-79a8b2fd-9701-41e5-a82c-4b24c905ec8d tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a431c9708f4694bc0d514133e76088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a1921237622439bab89676e11477c13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:32:45.748781 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-79a8b2fd-9701-41e5-a82c-4b24c905ec8d tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] 10.222.0.33 "GET /compute/v2.1/servers/a3dbac58-662d-4720-8bcf-2300f9a9a5d1" status: 200 len: 1735 microversion: 2.1 time: 0.231779 Jul 18 10:32:45.749340 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 265/532] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:32:45 2022] GET /compute/v2.1/servers/a3dbac58-662d-4720-8bcf-2300f9a9a5d1 => generated 1735 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:32:45.883400 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-2075cf93-b96d-4752-82de-b995939c9581 tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:32:45.884049 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-2075cf93-b96d-4752-82de-b995939c9581 tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] [instance: a6d1079b-c5d3-4062-9759-b681711cef09] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:32:45.890060 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-2075cf93-b96d-4752-82de-b995939c9581 tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:32:45.891005 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-2075cf93-b96d-4752-82de-b995939c9581 tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:32:45.891759 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-2075cf93-b96d-4752-82de-b995939c9581 tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:32:45.892187 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-2075cf93-b96d-4752-82de-b995939c9581 tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:32:45.905146 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.wsgi [None req-2075cf93-b96d-4752-82de-b995939c9581 tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] HTTP exception thrown: Instance a6d1079b-c5d3-4062-9759-b681711cef09 could not be found. Jul 18 10:32:45.907575 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-2075cf93-b96d-4752-82de-b995939c9581 tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Request method failure captured: Jul 18 10:32:45.907575 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: request: GET /compute/v2.1/servers/a6d1079b-c5d3-4062-9759-b681711cef09 HTTP/1.1 Jul 18 10:32:45.907575 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: Accept: application/json Jul 18 10:32:45.907575 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: Accept-Encoding: identity Jul 18 10:32:45.907575 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: Connection: close Jul 18 10:32:45.907575 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: Content-Length: 0 Jul 18 10:32:45.907575 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: Content-Type: application/json Jul 18 10:32:45.907575 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: Host: 10.222.0.33 Jul 18 10:32:45.907575 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: Openstack-System-Scope: None Jul 18 10:32:45.907575 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: User-Agent: python-urllib3/1.26.9 Jul 18 10:32:45.907575 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Auth-Token: gAAAAABi1TYsCCEd-uIhVXXHv9JaLkdkcB6EWKagewswES8W0Ml64Q0b4IBRrDzQ2yPfH_l_UFC6kYpaRMceDoDvm5OuNp5dTgL-y1qEOMLeCGwKtr-5CGnPTKkXL5BJ94M3uhRw33QP-I-OB3sPHTUkFXTvGX5aLMM_mrOirynsG56cBS4g1NE Jul 18 10:32:45.907575 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Domain-Id: None Jul 18 10:32:45.907575 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Domain-Name: None Jul 18 10:32:45.907575 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Identity-Status: Confirmed Jul 18 10:32:45.907575 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Is-Admin-Project: True Jul 18 10:32:45.907575 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Project-Domain-Id: default Jul 18 10:32:45.907575 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Project-Domain-Name: Default Jul 18 10:32:45.907575 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Project-Id: ee6203312784435b8cd1fdfede3fb597 Jul 18 10:32:45.907575 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Project-Name: tempest-VolumesSnapshotTestJSON-818269935 Jul 18 10:32:45.907575 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Role: member,reader Jul 18 10:32:45.907575 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Roles: member,reader Jul 18 10:32:45.909301 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ee6203312784435b8cd1fdfede3fb597"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ee6203312784435b8cd1fdfede3fb597"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/ee6203312784435b8cd1fdfede3fb597"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_ee6203312784435b8cd1fdfede3fb597"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jul 18 10:32:45.909301 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Tenant: tempest-VolumesSnapshotTestJSON-818269935 Jul 18 10:32:45.909301 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Tenant-Id: ee6203312784435b8cd1fdfede3fb597 Jul 18 10:32:45.909301 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-818269935 Jul 18 10:32:45.909301 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-User: tempest-VolumesSnapshotTestJSON-818269935-project Jul 18 10:32:45.909301 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-User-Domain-Id: default Jul 18 10:32:45.909301 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-User-Domain-Name: Default Jul 18 10:32:45.909301 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-User-Id: 8c9439cb644548b8b3b5fd5c610757b9 Jul 18 10:32:45.909301 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-User-Name: tempest-VolumesSnapshotTestJSON-818269935-project Jul 18 10:32:45.909301 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: method: > Jul 18 10:32:45.909301 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: exception: Instance a6d1079b-c5d3-4062-9759-b681711cef09 could not be found. Jul 18 10:32:45.909301 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: action_args: {'id': 'a6d1079b-c5d3-4062-9759-b681711cef09'} Jul 18 10:32:45.910152 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 10:32:45.910152 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:32:45.910152 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 10:32:45.910152 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 10:32:45.910152 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 10:32:45.910152 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 10:32:45.910152 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 10:32:45.910152 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 10:32:45.910152 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 10:32:45.910152 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 10:32:45.910152 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a6d1079b-c5d3-4062-9759-b681711cef09 could not be found. Jul 18 10:32:45.910152 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi Jul 18 10:32:45.910152 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:32:45.910152 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi Jul 18 10:32:45.910152 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:32:45.910152 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:32:45.910152 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:32:45.910152 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 10:32:45.910152 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 10:32:45.910152 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 10:32:45.911388 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 10:32:45.911388 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 10:32:45.911388 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 10:32:45.911388 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 10:32:45.911388 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 10:32:45.911388 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 10:32:45.911388 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 10:32:45.911388 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a6d1079b-c5d3-4062-9759-b681711cef09 could not be found. Jul 18 10:32:45.911388 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi Jul 18 10:32:45.911388 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:32:45.911388 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi Jul 18 10:32:45.911388 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:32:45.911388 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:32:45.911388 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:32:45.911388 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 10:32:45.911388 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 10:32:45.911388 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a6d1079b-c5d3-4062-9759-b681711cef09 could not be found. Jul 18 10:32:45.911388 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi Jul 18 10:32:45.912466 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-2075cf93-b96d-4752-82de-b995939c9581 tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] Returning 404 to user: Instance a6d1079b-c5d3-4062-9759-b681711cef09 could not be found. {{(pid=117879) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 10:32:45.912466 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-2075cf93-b96d-4752-82de-b995939c9581 tempest-VolumesSnapshotTestJSON-818269935 tempest-VolumesSnapshotTestJSON-818269935-project] 10.222.0.33 "GET /compute/v2.1/servers/a6d1079b-c5d3-4062-9759-b681711cef09" status: 404 len: 111 microversion: 2.1 time: 0.029718 Jul 18 10:32:45.912466 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 268/533] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:32:45 2022] GET /compute/v2.1/servers/a6d1079b-c5d3-4062-9759-b681711cef09 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 10:32:46.050643 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-8f019315-f6fd-4d4b-ab9f-a85f0aecf579 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:32:46.051254 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-8f019315-f6fd-4d4b-ab9f-a85f0aecf579 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] [instance: dcb1b50b-9e62-4ff3-9875-3d4635597b45] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:32:46.057254 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-8f019315-f6fd-4d4b-ab9f-a85f0aecf579 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:32:46.057699 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-8f019315-f6fd-4d4b-ab9f-a85f0aecf579 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:32:46.058461 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-8f019315-f6fd-4d4b-ab9f-a85f0aecf579 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:32:46.058897 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-8f019315-f6fd-4d4b-ab9f-a85f0aecf579 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:32:46.206856 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-8f019315-f6fd-4d4b-ab9f-a85f0aecf579 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '986f90dfbad14324b3fffbd790d60a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e487deb7ff45bdbf2cc002d42d12a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:32:46.214230 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-8f019315-f6fd-4d4b-ab9f-a85f0aecf579 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] 10.222.0.33 "GET /compute/v2.1/servers/dcb1b50b-9e62-4ff3-9875-3d4635597b45" status: 200 len: 1675 microversion: 2.1 time: 0.169465 Jul 18 10:32:46.214787 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 266/534] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:32:46 2022] GET /compute/v2.1/servers/dcb1b50b-9e62-4ff3-9875-3d4635597b45 => generated 1675 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:32:46.273780 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-df486fc1-d62b-48bd-a011-c9d3effd0558 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:32:46.274389 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-df486fc1-d62b-48bd-a011-c9d3effd0558 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] [instance: db62c05e-28a8-4121-a6e5-8abb802f7a17] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:32:46.280767 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-df486fc1-d62b-48bd-a011-c9d3effd0558 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:32:46.281248 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-df486fc1-d62b-48bd-a011-c9d3effd0558 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:32:46.282007 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-df486fc1-d62b-48bd-a011-c9d3effd0558 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:32:46.282444 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-df486fc1-d62b-48bd-a011-c9d3effd0558 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:32:46.286978 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG dbcounter [-] [117879] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:32:46.297042 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.wsgi [None req-df486fc1-d62b-48bd-a011-c9d3effd0558 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] HTTP exception thrown: Instance db62c05e-28a8-4121-a6e5-8abb802f7a17 could not be found. Jul 18 10:32:46.298619 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-df486fc1-d62b-48bd-a011-c9d3effd0558 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Request method failure captured: Jul 18 10:32:46.298619 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: request: GET /compute/v2.1/servers/db62c05e-28a8-4121-a6e5-8abb802f7a17 HTTP/1.1 Jul 18 10:32:46.298619 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: Accept: application/json Jul 18 10:32:46.298619 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: Accept-Encoding: identity Jul 18 10:32:46.298619 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: Connection: close Jul 18 10:32:46.298619 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: Content-Length: 0 Jul 18 10:32:46.298619 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: Content-Type: application/json Jul 18 10:32:46.298619 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: Host: 10.222.0.33 Jul 18 10:32:46.298619 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: Openstack-System-Scope: None Jul 18 10:32:46.298619 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: User-Agent: python-urllib3/1.26.9 Jul 18 10:32:46.298619 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Auth-Token: gAAAAABi1TXs5d9KA6TlIG1Li_VNjhkDxvVxs6ByaKH91Tp5cEYBI8OTiNSNI40UEe5MBLfNqlyuYAjUMpiV_qMg9jtmq9fJwxP3wvSLbrM9kN7Z4diK5bpD5WWlO_9PNIu02mzK2QxOqaTdn-MDBEh-IwIUUSwgtjyQOUrIhUK0fhFwotym42k Jul 18 10:32:46.298619 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Domain-Id: None Jul 18 10:32:46.298619 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Domain-Name: None Jul 18 10:32:46.298619 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Identity-Status: Confirmed Jul 18 10:32:46.298619 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Is-Admin-Project: True Jul 18 10:32:46.298619 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Project-Domain-Id: default Jul 18 10:32:46.298619 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Project-Domain-Name: Default Jul 18 10:32:46.298619 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Project-Id: 1cf3d5bfe9a745f38372c42c9cfa1f63 Jul 18 10:32:46.298619 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Project-Name: tempest-AttachVolumeNegativeTest-653274830 Jul 18 10:32:46.298619 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Role: member,reader Jul 18 10:32:46.298619 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Roles: member,reader Jul 18 10:32:46.300183 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1cf3d5bfe9a745f38372c42c9cfa1f63"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1cf3d5bfe9a745f38372c42c9cfa1f63"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/1cf3d5bfe9a745f38372c42c9cfa1f63"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_1cf3d5bfe9a745f38372c42c9cfa1f63"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jul 18 10:32:46.300183 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Tenant: tempest-AttachVolumeNegativeTest-653274830 Jul 18 10:32:46.300183 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Tenant-Id: 1cf3d5bfe9a745f38372c42c9cfa1f63 Jul 18 10:32:46.300183 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-653274830 Jul 18 10:32:46.300183 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-User: tempest-AttachVolumeNegativeTest-653274830-project Jul 18 10:32:46.300183 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-User-Domain-Id: default Jul 18 10:32:46.300183 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-User-Domain-Name: Default Jul 18 10:32:46.300183 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-User-Id: f25c72896a2d4d619e5ad4b5a0a79aa6 Jul 18 10:32:46.300183 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-User-Name: tempest-AttachVolumeNegativeTest-653274830-project Jul 18 10:32:46.300183 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: method: > Jul 18 10:32:46.300183 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: exception: Instance db62c05e-28a8-4121-a6e5-8abb802f7a17 could not be found. Jul 18 10:32:46.300183 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: action_args: {'id': 'db62c05e-28a8-4121-a6e5-8abb802f7a17'} Jul 18 10:32:46.301329 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 10:32:46.301329 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:32:46.301329 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 10:32:46.301329 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 10:32:46.301329 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 10:32:46.301329 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 10:32:46.301329 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 10:32:46.301329 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 10:32:46.301329 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 10:32:46.301329 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 10:32:46.301329 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance db62c05e-28a8-4121-a6e5-8abb802f7a17 could not be found. Jul 18 10:32:46.301329 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi Jul 18 10:32:46.301329 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:32:46.301329 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi Jul 18 10:32:46.301329 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:32:46.301329 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:32:46.301329 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:32:46.301329 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 10:32:46.301329 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 10:32:46.301329 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 10:32:46.303219 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 10:32:46.303219 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 10:32:46.303219 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 10:32:46.303219 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 10:32:46.303219 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 10:32:46.303219 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 10:32:46.303219 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 10:32:46.303219 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance db62c05e-28a8-4121-a6e5-8abb802f7a17 could not be found. Jul 18 10:32:46.303219 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi Jul 18 10:32:46.303219 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:32:46.303219 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi Jul 18 10:32:46.303219 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:32:46.303219 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:32:46.303219 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:32:46.303219 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 10:32:46.303219 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 10:32:46.303219 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance db62c05e-28a8-4121-a6e5-8abb802f7a17 could not be found. Jul 18 10:32:46.303219 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi Jul 18 10:32:46.304839 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-df486fc1-d62b-48bd-a011-c9d3effd0558 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Returning 404 to user: Instance db62c05e-28a8-4121-a6e5-8abb802f7a17 could not be found. {{(pid=117879) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 10:32:46.304839 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-df486fc1-d62b-48bd-a011-c9d3effd0558 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] 10.222.0.33 "GET /compute/v2.1/servers/db62c05e-28a8-4121-a6e5-8abb802f7a17" status: 404 len: 111 microversion: 2.1 time: 0.030090 Jul 18 10:32:46.304839 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 269/535] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:32:46 2022] GET /compute/v2.1/servers/db62c05e-28a8-4121-a6e5-8abb802f7a17 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 10:32:46.309089 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-39efc872-b449-4e14-997b-c64fcc5b420a tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Calling method '.version_select at 0x7f9f4a16cb80>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:32:46.327050 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-39efc872-b449-4e14-997b-c64fcc5b420a tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-681937332" status: 202 len: 0 microversion: 2.1 time: 0.021723 Jul 18 10:32:46.327627 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 267/536] 10.222.0.33 () {58 vars in 1217 bytes} [Mon Jul 18 10:32:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-681937332 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 10:32:46.766134 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-f69c4025-02c2-47df-a39f-3154c1028fa0 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:32:46.766747 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-f69c4025-02c2-47df-a39f-3154c1028fa0 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] [instance: a3dbac58-662d-4720-8bcf-2300f9a9a5d1] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:32:46.773537 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-f69c4025-02c2-47df-a39f-3154c1028fa0 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:32:46.773992 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-f69c4025-02c2-47df-a39f-3154c1028fa0 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:32:46.774751 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-f69c4025-02c2-47df-a39f-3154c1028fa0 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:32:46.775220 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-f69c4025-02c2-47df-a39f-3154c1028fa0 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:32:46.905843 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-f69c4025-02c2-47df-a39f-3154c1028fa0 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a431c9708f4694bc0d514133e76088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a1921237622439bab89676e11477c13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:32:46.914543 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-f69c4025-02c2-47df-a39f-3154c1028fa0 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] 10.222.0.33 "GET /compute/v2.1/servers/a3dbac58-662d-4720-8bcf-2300f9a9a5d1" status: 200 len: 1735 microversion: 2.1 time: 0.152669 Jul 18 10:32:46.915224 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 270/537] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:32:46 2022] GET /compute/v2.1/servers/a3dbac58-662d-4720-8bcf-2300f9a9a5d1 => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:32:46.964305 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-07c5feda-955c-4af8-ac09-0a77c0714841 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Action: 'create', calling method: .version_select at 0x7f9f49f3c160>, body: {"keypair": {"name": "tempest-keypair-1196383884", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBILsKJ3sRJ0MGK8i70N0K68OD5Q0owpqLMvyhpMFdq1vRrYHMaucx0ANfgk/5M1JGnJqzMS5d/WDhyM1Lp/5ss0WNWy+Oh5iPoAmJc+Acz0luCVYrZJFW5WXgHZb5UNr9Q=="}} {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:32:46.980223 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.quota [None req-07c5feda-955c-4af8-ac09-0a77c0714841 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Getting quotas for project 1cf3d5bfe9a745f38372c42c9cfa1f63. Resources: {'key_pairs'} {{(pid=117880) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 10:32:46.984047 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.quota [None req-07c5feda-955c-4af8-ac09-0a77c0714841 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Getting quotas for user f25c72896a2d4d619e5ad4b5a0a79aa6 and project 1cf3d5bfe9a745f38372c42c9cfa1f63. Resources: {'key_pairs'} {{(pid=117880) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 10:32:47.005479 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-07c5feda-955c-4af8-ac09-0a77c0714841 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.045752 Jul 18 10:32:47.006091 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 268/538] 10.222.0.33 () {60 vars in 1158 bytes} [Mon Jul 18 10:32:46 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:32:47.233200 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-639193dd-71e4-4be3-b517-250e444df591 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:32:47.233898 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-639193dd-71e4-4be3-b517-250e444df591 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] [instance: dcb1b50b-9e62-4ff3-9875-3d4635597b45] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:32:47.240084 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-639193dd-71e4-4be3-b517-250e444df591 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:32:47.240637 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-639193dd-71e4-4be3-b517-250e444df591 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:32:47.241489 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-639193dd-71e4-4be3-b517-250e444df591 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:32:47.242040 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-639193dd-71e4-4be3-b517-250e444df591 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:32:47.398075 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-639193dd-71e4-4be3-b517-250e444df591 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '986f90dfbad14324b3fffbd790d60a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e487deb7ff45bdbf2cc002d42d12a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:32:47.407470 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-639193dd-71e4-4be3-b517-250e444df591 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] 10.222.0.33 "GET /compute/v2.1/servers/dcb1b50b-9e62-4ff3-9875-3d4635597b45" status: 200 len: 1675 microversion: 2.1 time: 0.177855 Jul 18 10:32:47.409275 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 271/539] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:32:47 2022] GET /compute/v2.1/servers/dcb1b50b-9e62-4ff3-9875-3d4635597b45 => generated 1675 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:32:47.933349 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-aeaedd87-a34f-41a2-8694-f7a01d616082 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:32:47.933978 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-aeaedd87-a34f-41a2-8694-f7a01d616082 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] [instance: a3dbac58-662d-4720-8bcf-2300f9a9a5d1] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:32:47.940593 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-aeaedd87-a34f-41a2-8694-f7a01d616082 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:32:47.941048 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-aeaedd87-a34f-41a2-8694-f7a01d616082 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:32:47.941808 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-aeaedd87-a34f-41a2-8694-f7a01d616082 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:32:47.942245 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-aeaedd87-a34f-41a2-8694-f7a01d616082 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:32:48.164406 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-aeaedd87-a34f-41a2-8694-f7a01d616082 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a431c9708f4694bc0d514133e76088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a1921237622439bab89676e11477c13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:32:48.172933 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-aeaedd87-a34f-41a2-8694-f7a01d616082 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] 10.222.0.33 "GET /compute/v2.1/servers/a3dbac58-662d-4720-8bcf-2300f9a9a5d1" status: 200 len: 1735 microversion: 2.1 time: 0.243383 Jul 18 10:32:48.173505 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 269/540] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:32:47 2022] GET /compute/v2.1/servers/a3dbac58-662d-4720-8bcf-2300f9a9a5d1 => generated 1735 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:32:48.410276 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-d0ce0f6b-e158-4d2a-8339-525e0efbd9ac tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-65298497", "imageRef": "2cb02169-9999-411b-8c74-f88c068960fc", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a8d66173-a1e2-46af-a5dc-6e62a2d0a4e4"}], "security_groups": [{"name": "tempest-securitygroup--345567323"}], "key_name": "tempest-keypair-1196383884", "user_data": "}} {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:32:48.426880 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-5ff0dc98-4654-4173-96be-cabff7ab65b2 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:32:48.427480 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-5ff0dc98-4654-4173-96be-cabff7ab65b2 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] [instance: dcb1b50b-9e62-4ff3-9875-3d4635597b45] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:32:48.433393 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-5ff0dc98-4654-4173-96be-cabff7ab65b2 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:32:48.433836 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-5ff0dc98-4654-4173-96be-cabff7ab65b2 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:32:48.434598 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-5ff0dc98-4654-4173-96be-cabff7ab65b2 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:32:48.435030 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-5ff0dc98-4654-4173-96be-cabff7ab65b2 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:32:48.825580 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.network.neutron [None req-d0ce0f6b-e158-4d2a-8339-525e0efbd9ac tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] validate_networks() for [('a8d66173-a1e2-46af-a5dc-6e62a2d0a4e4', None, None, None, None, None)] {{(pid=117879) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 10:32:48.880802 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-5ff0dc98-4654-4173-96be-cabff7ab65b2 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '986f90dfbad14324b3fffbd790d60a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e487deb7ff45bdbf2cc002d42d12a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:32:48.889551 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-5ff0dc98-4654-4173-96be-cabff7ab65b2 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] 10.222.0.33 "GET /compute/v2.1/servers/dcb1b50b-9e62-4ff3-9875-3d4635597b45" status: 200 len: 1675 microversion: 2.1 time: 0.466371 Jul 18 10:32:48.890147 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 270/541] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:32:48 2022] GET /compute/v2.1/servers/dcb1b50b-9e62-4ff3-9875-3d4635597b45 => generated 1675 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:32:49.023930 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG dbcounter [-] [117879] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=117879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:32:49.190658 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-8a257fdc-9ad9-4ddf-9587-dd0a32aa8192 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:32:49.191214 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-8a257fdc-9ad9-4ddf-9587-dd0a32aa8192 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] [instance: a3dbac58-662d-4720-8bcf-2300f9a9a5d1] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:32:49.197332 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-8a257fdc-9ad9-4ddf-9587-dd0a32aa8192 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:32:49.197775 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-8a257fdc-9ad9-4ddf-9587-dd0a32aa8192 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:32:49.198533 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-8a257fdc-9ad9-4ddf-9587-dd0a32aa8192 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:32:49.198960 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-8a257fdc-9ad9-4ddf-9587-dd0a32aa8192 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:32:49.212466 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.virt.hardware [None req-d0ce0f6b-e158-4d2a-8339-525e0efbd9ac tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Flavor limits 0:0:0 {{(pid=117879) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 10:32:49.212941 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.virt.hardware [None req-d0ce0f6b-e158-4d2a-8339-525e0efbd9ac tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Image limits 0:0:0 {{(pid=117879) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 10:32:49.213411 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.virt.hardware [None req-d0ce0f6b-e158-4d2a-8339-525e0efbd9ac tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Flavor pref 0:0:0 {{(pid=117879) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 10:32:49.213822 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.virt.hardware [None req-d0ce0f6b-e158-4d2a-8339-525e0efbd9ac tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Image pref 0:0:0 {{(pid=117879) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 10:32:49.214236 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.virt.hardware [None req-d0ce0f6b-e158-4d2a-8339-525e0efbd9ac tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117879) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 10:32:49.224020 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-d0ce0f6b-e158-4d2a-8339-525e0efbd9ac tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:32:49.224472 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-d0ce0f6b-e158-4d2a-8339-525e0efbd9ac tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:32:49.225314 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-d0ce0f6b-e158-4d2a-8339-525e0efbd9ac tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:32:49.225756 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-d0ce0f6b-e158-4d2a-8339-525e0efbd9ac tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:32:49.242594 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.quota [None req-d0ce0f6b-e158-4d2a-8339-525e0efbd9ac tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Getting quotas for project 1cf3d5bfe9a745f38372c42c9cfa1f63. Resources: {'ram', 'cores', 'instances'} {{(pid=117879) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 10:32:49.246574 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.quota [None req-d0ce0f6b-e158-4d2a-8339-525e0efbd9ac tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Getting quotas for user f25c72896a2d4d619e5ad4b5a0a79aa6 and project 1cf3d5bfe9a745f38372c42c9cfa1f63. Resources: {'ram', 'cores', 'instances'} {{(pid=117879) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 10:32:49.258352 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-d0ce0f6b-e158-4d2a-8339-525e0efbd9ac tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Going to run 1 instances... {{(pid=117879) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 10:32:49.260644 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-d0ce0f6b-e158-4d2a-8339-525e0efbd9ac tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] [instance: 54754961-403d-4f99-98c1-727db8528d91] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2cb02169-9999-411b-8c74-f88c068960fc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117879) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 10:32:49.306856 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-d0ce0f6b-e158-4d2a-8339-525e0efbd9ac tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.901255 Jul 18 10:32:49.307712 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 272/542] 10.222.0.33 () {60 vars in 1146 bytes} [Mon Jul 18 10:32:48 2022] POST /compute/v2.1/servers => generated 401 bytes in 903 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 10:32:49.317988 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-4d06a535-e581-4b1e-9788-e0799a8edca9 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:32:49.318932 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-4d06a535-e581-4b1e-9788-e0799a8edca9 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] [instance: 54754961-403d-4f99-98c1-727db8528d91] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:32:49.345089 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-8a257fdc-9ad9-4ddf-9587-dd0a32aa8192 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a431c9708f4694bc0d514133e76088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a1921237622439bab89676e11477c13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:32:49.354031 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-8a257fdc-9ad9-4ddf-9587-dd0a32aa8192 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] 10.222.0.33 "GET /compute/v2.1/servers/a3dbac58-662d-4720-8bcf-2300f9a9a5d1" status: 200 len: 1735 microversion: 2.1 time: 0.168072 Jul 18 10:32:49.356560 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 271/543] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:32:49 2022] GET /compute/v2.1/servers/a3dbac58-662d-4720-8bcf-2300f9a9a5d1 => generated 1735 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:32:49.388906 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-4d06a535-e581-4b1e-9788-e0799a8edca9 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f25c72896a2d4d619e5ad4b5a0a79aa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cf3d5bfe9a745f38372c42c9cfa1f63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:32:49.396152 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-4d06a535-e581-4b1e-9788-e0799a8edca9 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] 10.222.0.33 "GET /compute/v2.1/servers/54754961-403d-4f99-98c1-727db8528d91" status: 200 len: 1240 microversion: 2.1 time: 0.082037 Jul 18 10:32:49.396729 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 273/544] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:32:49 2022] GET /compute/v2.1/servers/54754961-403d-4f99-98c1-727db8528d91 => generated 1240 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:32:49.907907 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-f3706888-12ea-43ac-bebe-50f8b8a8001a tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:32:49.908429 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-f3706888-12ea-43ac-bebe-50f8b8a8001a tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] [instance: dcb1b50b-9e62-4ff3-9875-3d4635597b45] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:32:49.914438 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-f3706888-12ea-43ac-bebe-50f8b8a8001a tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:32:49.914885 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-f3706888-12ea-43ac-bebe-50f8b8a8001a tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:32:49.915634 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-f3706888-12ea-43ac-bebe-50f8b8a8001a tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:32:49.916074 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-f3706888-12ea-43ac-bebe-50f8b8a8001a tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:32:50.046245 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-f3706888-12ea-43ac-bebe-50f8b8a8001a tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '986f90dfbad14324b3fffbd790d60a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e487deb7ff45bdbf2cc002d42d12a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:32:50.054363 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-f3706888-12ea-43ac-bebe-50f8b8a8001a tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] 10.222.0.33 "GET /compute/v2.1/servers/dcb1b50b-9e62-4ff3-9875-3d4635597b45" status: 200 len: 1675 microversion: 2.1 time: 0.150784 Jul 18 10:32:50.054917 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 272/545] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:32:49 2022] GET /compute/v2.1/servers/dcb1b50b-9e62-4ff3-9875-3d4635597b45 => generated 1675 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:32:50.372364 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-8b85e7a1-6549-4c28-ae2a-8e3fb0f7280f tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:32:50.373000 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-8b85e7a1-6549-4c28-ae2a-8e3fb0f7280f tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] [instance: a3dbac58-662d-4720-8bcf-2300f9a9a5d1] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:32:50.379811 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-8b85e7a1-6549-4c28-ae2a-8e3fb0f7280f tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:32:50.380260 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-8b85e7a1-6549-4c28-ae2a-8e3fb0f7280f tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:32:50.381242 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-8b85e7a1-6549-4c28-ae2a-8e3fb0f7280f tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:32:50.381674 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-8b85e7a1-6549-4c28-ae2a-8e3fb0f7280f tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:32:50.413075 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-1d5a5047-014c-48fd-9e7d-229af18c6331 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:32:50.414412 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-1d5a5047-014c-48fd-9e7d-229af18c6331 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] [instance: 54754961-403d-4f99-98c1-727db8528d91] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:32:50.424914 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-1d5a5047-014c-48fd-9e7d-229af18c6331 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:32:50.425850 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-1d5a5047-014c-48fd-9e7d-229af18c6331 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:32:50.426723 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-1d5a5047-014c-48fd-9e7d-229af18c6331 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:32:50.427371 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-1d5a5047-014c-48fd-9e7d-229af18c6331 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:32:50.505263 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-1d5a5047-014c-48fd-9e7d-229af18c6331 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f25c72896a2d4d619e5ad4b5a0a79aa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cf3d5bfe9a745f38372c42c9cfa1f63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:32:50.512649 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-1d5a5047-014c-48fd-9e7d-229af18c6331 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] 10.222.0.33 "GET /compute/v2.1/servers/54754961-403d-4f99-98c1-727db8528d91" status: 200 len: 1244 microversion: 2.1 time: 0.103294 Jul 18 10:32:50.513219 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 273/546] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:32:50 2022] GET /compute/v2.1/servers/54754961-403d-4f99-98c1-727db8528d91 => generated 1244 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:32:50.538962 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-8b85e7a1-6549-4c28-ae2a-8e3fb0f7280f tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a431c9708f4694bc0d514133e76088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a1921237622439bab89676e11477c13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:32:50.546935 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-8b85e7a1-6549-4c28-ae2a-8e3fb0f7280f tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] 10.222.0.33 "GET /compute/v2.1/servers/a3dbac58-662d-4720-8bcf-2300f9a9a5d1" status: 200 len: 1735 microversion: 2.1 time: 0.179505 Jul 18 10:32:50.547501 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 274/547] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:32:50 2022] GET /compute/v2.1/servers/a3dbac58-662d-4720-8bcf-2300f9a9a5d1 => generated 1735 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:32:51.071485 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-57dc2d94-4b1c-4614-9d0a-377869afc9b3 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:32:51.072085 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-57dc2d94-4b1c-4614-9d0a-377869afc9b3 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] [instance: dcb1b50b-9e62-4ff3-9875-3d4635597b45] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:32:51.078557 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-57dc2d94-4b1c-4614-9d0a-377869afc9b3 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:32:51.079025 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-57dc2d94-4b1c-4614-9d0a-377869afc9b3 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:32:51.079800 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-57dc2d94-4b1c-4614-9d0a-377869afc9b3 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:32:51.080227 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-57dc2d94-4b1c-4614-9d0a-377869afc9b3 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:32:51.208379 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-57dc2d94-4b1c-4614-9d0a-377869afc9b3 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '986f90dfbad14324b3fffbd790d60a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e487deb7ff45bdbf2cc002d42d12a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:32:51.215791 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-57dc2d94-4b1c-4614-9d0a-377869afc9b3 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] 10.222.0.33 "GET /compute/v2.1/servers/dcb1b50b-9e62-4ff3-9875-3d4635597b45" status: 200 len: 1675 microversion: 2.1 time: 0.148098 Jul 18 10:32:51.216348 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 274/548] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:32:51 2022] GET /compute/v2.1/servers/dcb1b50b-9e62-4ff3-9875-3d4635597b45 => generated 1675 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:32:51.530325 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-46668d40-fdab-48ad-81be-07bc96779a35 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:32:51.530846 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-46668d40-fdab-48ad-81be-07bc96779a35 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] [instance: 54754961-403d-4f99-98c1-727db8528d91] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:32:51.537489 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-46668d40-fdab-48ad-81be-07bc96779a35 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:32:51.537948 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-46668d40-fdab-48ad-81be-07bc96779a35 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:32:51.538712 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-46668d40-fdab-48ad-81be-07bc96779a35 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:32:51.539154 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-46668d40-fdab-48ad-81be-07bc96779a35 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:32:51.567225 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-48b9232d-8e5b-42b1-83c1-adcacea5f220 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:32:51.568388 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-48b9232d-8e5b-42b1-83c1-adcacea5f220 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] [instance: a3dbac58-662d-4720-8bcf-2300f9a9a5d1] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:32:51.575360 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-48b9232d-8e5b-42b1-83c1-adcacea5f220 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:32:51.575919 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-48b9232d-8e5b-42b1-83c1-adcacea5f220 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:32:51.576768 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-48b9232d-8e5b-42b1-83c1-adcacea5f220 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:32:51.577378 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-48b9232d-8e5b-42b1-83c1-adcacea5f220 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:32:51.606552 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-46668d40-fdab-48ad-81be-07bc96779a35 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f25c72896a2d4d619e5ad4b5a0a79aa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cf3d5bfe9a745f38372c42c9cfa1f63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:32:51.614423 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-46668d40-fdab-48ad-81be-07bc96779a35 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] 10.222.0.33 "GET /compute/v2.1/servers/54754961-403d-4f99-98c1-727db8528d91" status: 200 len: 1292 microversion: 2.1 time: 0.088057 Jul 18 10:32:51.624412 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 275/549] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:32:51 2022] GET /compute/v2.1/servers/54754961-403d-4f99-98c1-727db8528d91 => generated 1292 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:32:51.721971 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-48b9232d-8e5b-42b1-83c1-adcacea5f220 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a431c9708f4694bc0d514133e76088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a1921237622439bab89676e11477c13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:32:51.730148 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-48b9232d-8e5b-42b1-83c1-adcacea5f220 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] 10.222.0.33 "GET /compute/v2.1/servers/a3dbac58-662d-4720-8bcf-2300f9a9a5d1" status: 200 len: 1735 microversion: 2.1 time: 0.166724 Jul 18 10:32:51.730700 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 275/550] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:32:51 2022] GET /compute/v2.1/servers/a3dbac58-662d-4720-8bcf-2300f9a9a5d1 => generated 1735 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:32:52.234660 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-5ea5c030-d7db-4bb2-ad55-b6a283430683 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:32:52.235262 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-5ea5c030-d7db-4bb2-ad55-b6a283430683 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] [instance: dcb1b50b-9e62-4ff3-9875-3d4635597b45] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:32:52.241580 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-5ea5c030-d7db-4bb2-ad55-b6a283430683 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:32:52.242374 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-5ea5c030-d7db-4bb2-ad55-b6a283430683 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:32:52.243433 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-5ea5c030-d7db-4bb2-ad55-b6a283430683 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:32:52.243860 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-5ea5c030-d7db-4bb2-ad55-b6a283430683 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:32:52.406721 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-5ea5c030-d7db-4bb2-ad55-b6a283430683 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '986f90dfbad14324b3fffbd790d60a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e487deb7ff45bdbf2cc002d42d12a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:32:52.414992 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-5ea5c030-d7db-4bb2-ad55-b6a283430683 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] 10.222.0.33 "GET /compute/v2.1/servers/dcb1b50b-9e62-4ff3-9875-3d4635597b45" status: 200 len: 1675 microversion: 2.1 time: 0.184148 Jul 18 10:32:52.415723 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 276/551] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:32:52 2022] GET /compute/v2.1/servers/dcb1b50b-9e62-4ff3-9875-3d4635597b45 => generated 1675 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:32:52.631267 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-0b12978f-8f8c-4f9b-83c2-88c83b634abe tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:32:52.631867 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-0b12978f-8f8c-4f9b-83c2-88c83b634abe tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] [instance: 54754961-403d-4f99-98c1-727db8528d91] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:32:52.638424 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-0b12978f-8f8c-4f9b-83c2-88c83b634abe tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:32:52.638866 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-0b12978f-8f8c-4f9b-83c2-88c83b634abe tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:32:52.639613 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-0b12978f-8f8c-4f9b-83c2-88c83b634abe tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:32:52.640040 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-0b12978f-8f8c-4f9b-83c2-88c83b634abe tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:32:52.713287 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-0b12978f-8f8c-4f9b-83c2-88c83b634abe tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f25c72896a2d4d619e5ad4b5a0a79aa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cf3d5bfe9a745f38372c42c9cfa1f63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:32:52.715636 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG dbcounter [-] [117880] Writing DB stats nova_cell1:SELECT=100 {{(pid=117880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:32:52.720553 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-0b12978f-8f8c-4f9b-83c2-88c83b634abe tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] 10.222.0.33 "GET /compute/v2.1/servers/54754961-403d-4f99-98c1-727db8528d91" status: 200 len: 1292 microversion: 2.1 time: 0.092684 Jul 18 10:32:52.721598 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 276/552] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:32:52 2022] GET /compute/v2.1/servers/54754961-403d-4f99-98c1-727db8528d91 => generated 1292 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:32:52.748281 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-c455faa3-bf74-42d8-a186-6d270a1b5868 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:32:52.748914 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-c455faa3-bf74-42d8-a186-6d270a1b5868 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] [instance: a3dbac58-662d-4720-8bcf-2300f9a9a5d1] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:32:52.756963 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-c455faa3-bf74-42d8-a186-6d270a1b5868 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:32:52.757407 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-c455faa3-bf74-42d8-a186-6d270a1b5868 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:32:52.758185 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-c455faa3-bf74-42d8-a186-6d270a1b5868 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:32:52.758625 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-c455faa3-bf74-42d8-a186-6d270a1b5868 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:32:52.827018 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-3398bad1-cf3a-4c65-acb7-34314be0cd38 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1976415117", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-986614198", "security_groups": [{"name": "tempest-secgroup-smoke-350612805"}], "block_device_mapping_v2": [{"uuid": "fa7171d5-c853-4a34-9f73-34827b083477", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "9e654fce-ea72-45f2-b759-da2c9a65544d"}]}} {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:32:52.891055 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-c455faa3-bf74-42d8-a186-6d270a1b5868 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a431c9708f4694bc0d514133e76088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a1921237622439bab89676e11477c13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:32:52.899158 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-c455faa3-bf74-42d8-a186-6d270a1b5868 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] 10.222.0.33 "GET /compute/v2.1/servers/a3dbac58-662d-4720-8bcf-2300f9a9a5d1" status: 200 len: 1735 microversion: 2.1 time: 0.155518 Jul 18 10:32:52.899728 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 277/553] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:32:52 2022] GET /compute/v2.1/servers/a3dbac58-662d-4720-8bcf-2300f9a9a5d1 => generated 1735 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:32:52.942419 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.network.neutron [None req-3398bad1-cf3a-4c65-acb7-34314be0cd38 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] validate_networks() for [('9e654fce-ea72-45f2-b759-da2c9a65544d', None, None, None, None, None)] {{(pid=117880) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 10:32:53.433080 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-93fbbdee-7225-40a1-a82b-a9076afe635c tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:32:53.433726 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-93fbbdee-7225-40a1-a82b-a9076afe635c tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] [instance: dcb1b50b-9e62-4ff3-9875-3d4635597b45] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:32:53.439778 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-93fbbdee-7225-40a1-a82b-a9076afe635c tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:32:53.440172 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-93fbbdee-7225-40a1-a82b-a9076afe635c tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:32:53.441138 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-93fbbdee-7225-40a1-a82b-a9076afe635c tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:32:53.441586 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-93fbbdee-7225-40a1-a82b-a9076afe635c tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:32:53.455019 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.virt.hardware [None req-3398bad1-cf3a-4c65-acb7-34314be0cd38 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Flavor limits 0:0:0 {{(pid=117880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 10:32:53.455439 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.virt.hardware [None req-3398bad1-cf3a-4c65-acb7-34314be0cd38 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Image limits 0:0:0 {{(pid=117880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 10:32:53.455915 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.virt.hardware [None req-3398bad1-cf3a-4c65-acb7-34314be0cd38 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Flavor pref 0:0:0 {{(pid=117880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 10:32:53.456317 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.virt.hardware [None req-3398bad1-cf3a-4c65-acb7-34314be0cd38 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Image pref 0:0:0 {{(pid=117880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 10:32:53.456760 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.virt.hardware [None req-3398bad1-cf3a-4c65-acb7-34314be0cd38 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 10:32:53.465525 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-3398bad1-cf3a-4c65-acb7-34314be0cd38 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:32:53.465974 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-3398bad1-cf3a-4c65-acb7-34314be0cd38 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:32:53.466760 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-3398bad1-cf3a-4c65-acb7-34314be0cd38 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:32:53.467218 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-3398bad1-cf3a-4c65-acb7-34314be0cd38 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:32:53.487372 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.quota [None req-3398bad1-cf3a-4c65-acb7-34314be0cd38 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Getting quotas for project 2c656b71bbd447cba7d11335c928dfda. Resources: {'ram', 'cores', 'instances'} {{(pid=117880) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 10:32:53.491354 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.quota [None req-3398bad1-cf3a-4c65-acb7-34314be0cd38 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Getting quotas for user 4e9eb8d188e040bca894e038955f2402 and project 2c656b71bbd447cba7d11335c928dfda. Resources: {'ram', 'cores', 'instances'} {{(pid=117880) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 10:32:53.550828 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-3398bad1-cf3a-4c65-acb7-34314be0cd38 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Going to run 1 instances... {{(pid=117880) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 10:32:53.552929 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-3398bad1-cf3a-4c65-acb7-34314be0cd38 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] [instance: 22a03003-3677-426e-8fb8-5b58998eef8a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='fa7171d5-c853-4a34-9f73-34827b083477',volume_size=None,volume_type=None)] {{(pid=117880) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 10:32:53.572536 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-93fbbdee-7225-40a1-a82b-a9076afe635c tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '986f90dfbad14324b3fffbd790d60a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e487deb7ff45bdbf2cc002d42d12a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:32:53.581544 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-93fbbdee-7225-40a1-a82b-a9076afe635c tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] 10.222.0.33 "GET /compute/v2.1/servers/dcb1b50b-9e62-4ff3-9875-3d4635597b45" status: 200 len: 1675 microversion: 2.1 time: 0.152044 Jul 18 10:32:53.582711 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 278/554] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:32:53 2022] GET /compute/v2.1/servers/dcb1b50b-9e62-4ff3-9875-3d4635597b45 => generated 1675 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:32:53.717332 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-3398bad1-cf3a-4c65-acb7-34314be0cd38 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.894492 Jul 18 10:32:53.717886 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 277/555] 10.222.0.33 () {60 vars in 1146 bytes} [Mon Jul 18 10:32:52 2022] POST /compute/v2.1/servers => generated 405 bytes in 896 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 18 10:32:53.728513 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-f46cdb65-cad2-4742-95f3-3a7e9a57b1b7 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:32:53.729131 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-f46cdb65-cad2-4742-95f3-3a7e9a57b1b7 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] [instance: 22a03003-3677-426e-8fb8-5b58998eef8a] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:32:53.740167 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-df07c1dd-ab8b-46ce-98c7-4c63dd7ceece tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:32:53.740755 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-df07c1dd-ab8b-46ce-98c7-4c63dd7ceece tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] [instance: 54754961-403d-4f99-98c1-727db8528d91] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:32:53.755268 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-df07c1dd-ab8b-46ce-98c7-4c63dd7ceece tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:32:53.756016 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-df07c1dd-ab8b-46ce-98c7-4c63dd7ceece tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:32:53.756865 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-df07c1dd-ab8b-46ce-98c7-4c63dd7ceece tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:32:53.757304 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-df07c1dd-ab8b-46ce-98c7-4c63dd7ceece tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:32:53.848543 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-f46cdb65-cad2-4742-95f3-3a7e9a57b1b7 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9eb8d188e040bca894e038955f2402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c656b71bbd447cba7d11335c928dfda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:32:53.855725 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-f46cdb65-cad2-4742-95f3-3a7e9a57b1b7 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] 10.222.0.33 "GET /compute/v2.1/servers/22a03003-3677-426e-8fb8-5b58998eef8a" status: 200 len: 1094 microversion: 2.1 time: 0.131167 Jul 18 10:32:53.856519 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 279/556] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:32:53 2022] GET /compute/v2.1/servers/22a03003-3677-426e-8fb8-5b58998eef8a => generated 1094 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:32:53.876355 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-df07c1dd-ab8b-46ce-98c7-4c63dd7ceece tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f25c72896a2d4d619e5ad4b5a0a79aa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cf3d5bfe9a745f38372c42c9cfa1f63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:32:53.883742 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-df07c1dd-ab8b-46ce-98c7-4c63dd7ceece tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] 10.222.0.33 "GET /compute/v2.1/servers/54754961-403d-4f99-98c1-727db8528d91" status: 200 len: 1298 microversion: 2.1 time: 0.149704 Jul 18 10:32:53.884388 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 278/557] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:32:53 2022] GET /compute/v2.1/servers/54754961-403d-4f99-98c1-727db8528d91 => generated 1298 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:32:53.918973 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-27201771-8e71-487a-abcc-05a574681123 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:32:53.919567 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-27201771-8e71-487a-abcc-05a574681123 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] [instance: a3dbac58-662d-4720-8bcf-2300f9a9a5d1] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:32:53.927352 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-27201771-8e71-487a-abcc-05a574681123 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:32:53.927815 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-27201771-8e71-487a-abcc-05a574681123 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:32:53.928619 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-27201771-8e71-487a-abcc-05a574681123 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:32:53.929060 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-27201771-8e71-487a-abcc-05a574681123 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:32:54.159346 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-27201771-8e71-487a-abcc-05a574681123 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a431c9708f4694bc0d514133e76088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a1921237622439bab89676e11477c13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:32:54.168448 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-27201771-8e71-487a-abcc-05a574681123 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] 10.222.0.33 "GET /compute/v2.1/servers/a3dbac58-662d-4720-8bcf-2300f9a9a5d1" status: 200 len: 1735 microversion: 2.1 time: 0.253388 Jul 18 10:32:54.169051 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 280/558] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:32:53 2022] GET /compute/v2.1/servers/a3dbac58-662d-4720-8bcf-2300f9a9a5d1 => generated 1735 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:32:54.600889 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-676152f6-c53b-49a1-9da7-a4d5f88492c1 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:32:54.601495 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-676152f6-c53b-49a1-9da7-a4d5f88492c1 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] [instance: dcb1b50b-9e62-4ff3-9875-3d4635597b45] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:32:54.607856 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-676152f6-c53b-49a1-9da7-a4d5f88492c1 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:32:54.608307 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-676152f6-c53b-49a1-9da7-a4d5f88492c1 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:32:54.609633 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-676152f6-c53b-49a1-9da7-a4d5f88492c1 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:32:54.610068 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-676152f6-c53b-49a1-9da7-a4d5f88492c1 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:32:54.748644 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-676152f6-c53b-49a1-9da7-a4d5f88492c1 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '986f90dfbad14324b3fffbd790d60a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e487deb7ff45bdbf2cc002d42d12a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:32:54.757170 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-676152f6-c53b-49a1-9da7-a4d5f88492c1 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] 10.222.0.33 "GET /compute/v2.1/servers/dcb1b50b-9e62-4ff3-9875-3d4635597b45" status: 200 len: 1675 microversion: 2.1 time: 0.160383 Jul 18 10:32:54.757958 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 279/559] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:32:54 2022] GET /compute/v2.1/servers/dcb1b50b-9e62-4ff3-9875-3d4635597b45 => generated 1675 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:32:54.871719 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-b375ea06-dec1-405a-8bce-502e00ac0a13 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:32:54.872320 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-b375ea06-dec1-405a-8bce-502e00ac0a13 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] [instance: 22a03003-3677-426e-8fb8-5b58998eef8a] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:32:54.879706 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-b375ea06-dec1-405a-8bce-502e00ac0a13 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:32:54.880161 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-b375ea06-dec1-405a-8bce-502e00ac0a13 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:32:54.880979 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-b375ea06-dec1-405a-8bce-502e00ac0a13 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:32:54.881422 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-b375ea06-dec1-405a-8bce-502e00ac0a13 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:32:54.902379 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-39a688e3-358a-4c88-8080-6f9eda5063e9 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:32:54.902988 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-39a688e3-358a-4c88-8080-6f9eda5063e9 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] [instance: 54754961-403d-4f99-98c1-727db8528d91] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:32:54.905399 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG dbcounter [-] [117880] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=117880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:32:54.914121 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-39a688e3-358a-4c88-8080-6f9eda5063e9 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:32:54.914995 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-39a688e3-358a-4c88-8080-6f9eda5063e9 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:32:54.916031 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-39a688e3-358a-4c88-8080-6f9eda5063e9 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:32:54.916703 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-39a688e3-358a-4c88-8080-6f9eda5063e9 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:32:54.944797 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-b375ea06-dec1-405a-8bce-502e00ac0a13 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9eb8d188e040bca894e038955f2402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c656b71bbd447cba7d11335c928dfda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:32:54.953023 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-b375ea06-dec1-405a-8bce-502e00ac0a13 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] 10.222.0.33 "GET /compute/v2.1/servers/22a03003-3677-426e-8fb8-5b58998eef8a" status: 200 len: 1192 microversion: 2.1 time: 0.085040 Jul 18 10:32:54.953864 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 281/560] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:32:54 2022] GET /compute/v2.1/servers/22a03003-3677-426e-8fb8-5b58998eef8a => generated 1192 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:32:55.154244 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-39a688e3-358a-4c88-8080-6f9eda5063e9 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f25c72896a2d4d619e5ad4b5a0a79aa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cf3d5bfe9a745f38372c42c9cfa1f63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:32:55.169064 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-39a688e3-358a-4c88-8080-6f9eda5063e9 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] 10.222.0.33 "GET /compute/v2.1/servers/54754961-403d-4f99-98c1-727db8528d91" status: 200 len: 1365 microversion: 2.1 time: 0.270370 Jul 18 10:32:55.169722 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 280/561] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:32:54 2022] GET /compute/v2.1/servers/54754961-403d-4f99-98c1-727db8528d91 => generated 1365 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:32:55.190994 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-6774802c-8251-4d1b-a7de-134f68dafbc0 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:32:55.192913 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-6774802c-8251-4d1b-a7de-134f68dafbc0 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] [instance: a3dbac58-662d-4720-8bcf-2300f9a9a5d1] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:32:55.203813 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-6774802c-8251-4d1b-a7de-134f68dafbc0 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:32:55.204569 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-6774802c-8251-4d1b-a7de-134f68dafbc0 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:32:55.205508 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-6774802c-8251-4d1b-a7de-134f68dafbc0 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:32:55.206101 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-6774802c-8251-4d1b-a7de-134f68dafbc0 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:32:55.534588 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-6774802c-8251-4d1b-a7de-134f68dafbc0 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a431c9708f4694bc0d514133e76088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a1921237622439bab89676e11477c13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:32:55.548359 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-6774802c-8251-4d1b-a7de-134f68dafbc0 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] 10.222.0.33 "GET /compute/v2.1/servers/a3dbac58-662d-4720-8bcf-2300f9a9a5d1" status: 200 len: 1715 microversion: 2.1 time: 0.364303 Jul 18 10:32:55.549501 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 282/562] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:32:55 2022] GET /compute/v2.1/servers/a3dbac58-662d-4720-8bcf-2300f9a9a5d1 => generated 1715 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:32:55.666351 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-6dd6ca3e-df75-47d1-abe9-3abc1f348857 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:32:55.667233 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-6dd6ca3e-df75-47d1-abe9-3abc1f348857 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] [instance: a3dbac58-662d-4720-8bcf-2300f9a9a5d1] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:32:55.673825 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-6dd6ca3e-df75-47d1-abe9-3abc1f348857 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:32:55.674581 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-6dd6ca3e-df75-47d1-abe9-3abc1f348857 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:32:55.675566 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-6dd6ca3e-df75-47d1-abe9-3abc1f348857 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:32:55.676251 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-6dd6ca3e-df75-47d1-abe9-3abc1f348857 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:32:55.775896 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-97c3f221-25ad-4c6a-8171-3fae9fe81fd4 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:32:55.776709 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-97c3f221-25ad-4c6a-8171-3fae9fe81fd4 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] [instance: dcb1b50b-9e62-4ff3-9875-3d4635597b45] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:32:55.787902 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-97c3f221-25ad-4c6a-8171-3fae9fe81fd4 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:32:55.788784 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-97c3f221-25ad-4c6a-8171-3fae9fe81fd4 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:32:55.792772 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.wsgi [None req-6dd6ca3e-df75-47d1-abe9-3abc1f348857 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] HTTP exception thrown: Cannot 'detach_volume' instance a3dbac58-662d-4720-8bcf-2300f9a9a5d1 while it is in vm_state rescued Jul 18 10:32:55.793480 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-97c3f221-25ad-4c6a-8171-3fae9fe81fd4 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:32:55.794281 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-97c3f221-25ad-4c6a-8171-3fae9fe81fd4 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:32:55.794677 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-6dd6ca3e-df75-47d1-abe9-3abc1f348857 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Request method failure captured: Jul 18 10:32:55.794677 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: request: DELETE /compute/v2.1/servers/a3dbac58-662d-4720-8bcf-2300f9a9a5d1/os-volume_attachments/763d6f81-f7c8-4a96-be85-5afcc42a6739 HTTP/1.1 Jul 18 10:32:55.794677 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: Accept: application/json Jul 18 10:32:55.794677 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: Accept-Encoding: identity Jul 18 10:32:55.794677 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: Connection: close Jul 18 10:32:55.794677 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: Content-Length: 0 Jul 18 10:32:55.794677 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: Content-Type: application/json Jul 18 10:32:55.794677 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: Host: 10.222.0.33 Jul 18 10:32:55.794677 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: Openstack-System-Scope: None Jul 18 10:32:55.794677 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: User-Agent: python-urllib3/1.26.9 Jul 18 10:32:55.794677 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Auth-Token: gAAAAABi1TXwn_mK_f7kuXECN8SGyXeI6MkiVur1cBGu0x9uwAf9xlFmP_-pUfPg46JxcRhK0sdtXAw2aOkGpoBZqQnqLV_xkZTvI1OQD5pPdoysYJdyciJL2bXUdpnFbLgqC6bxNJTUhgXK9B7t-8gSneKlpBB0M32nX-UxxWq_GmI2i5lMPM8 Jul 18 10:32:55.794677 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Domain-Id: None Jul 18 10:32:55.794677 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Domain-Name: None Jul 18 10:32:55.794677 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Identity-Status: Confirmed Jul 18 10:32:55.794677 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Is-Admin-Project: True Jul 18 10:32:55.794677 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Project-Domain-Id: default Jul 18 10:32:55.794677 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Project-Domain-Name: Default Jul 18 10:32:55.794677 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Project-Id: 8a1921237622439bab89676e11477c13 Jul 18 10:32:55.794677 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-33766307 Jul 18 10:32:55.794677 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Role: member,reader Jul 18 10:32:55.794677 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Roles: member,reader Jul 18 10:32:55.796664 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8a1921237622439bab89676e11477c13"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8a1921237622439bab89676e11477c13"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/8a1921237622439bab89676e11477c13"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_8a1921237622439bab89676e11477c13"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jul 18 10:32:55.796664 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Tenant: tempest-ServerRescueNegativeTestJSON-33766307 Jul 18 10:32:55.796664 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Tenant-Id: 8a1921237622439bab89676e11477c13 Jul 18 10:32:55.796664 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-33766307 Jul 18 10:32:55.796664 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-User: tempest-ServerRescueNegativeTestJSON-33766307-project Jul 18 10:32:55.796664 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-User-Domain-Id: default Jul 18 10:32:55.796664 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-User-Domain-Name: Default Jul 18 10:32:55.796664 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-User-Id: 72a431c9708f4694bc0d514133e76088 Jul 18 10:32:55.796664 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-User-Name: tempest-ServerRescueNegativeTestJSON-33766307-project Jul 18 10:32:55.796664 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: method: > Jul 18 10:32:55.796664 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: exception: Cannot 'detach_volume' instance a3dbac58-662d-4720-8bcf-2300f9a9a5d1 while it is in vm_state rescued Jul 18 10:32:55.797433 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: action_args: {'server_id': 'a3dbac58-662d-4720-8bcf-2300f9a9a5d1', 'id': '763d6f81-f7c8-4a96-be85-5afcc42a6739'} Jul 18 10:32:55.797433 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 10:32:55.797433 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:32:55.797433 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jul 18 10:32:55.797433 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jul 18 10:32:55.797433 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 18 10:32:55.797433 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 18 10:32:55.797433 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 18 10:32:55.797433 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 18 10:32:55.797433 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance a3dbac58-662d-4720-8bcf-2300f9a9a5d1 in vm_state rescued. Cannot detach_volume while the instance is in this state. Jul 18 10:32:55.797433 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi Jul 18 10:32:55.797433 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:32:55.797433 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi Jul 18 10:32:55.797433 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:32:55.797433 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:32:55.797433 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:32:55.797433 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 10:32:55.797433 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 10:32:55.797433 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 10:32:55.797433 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 10:32:55.799768 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jul 18 10:32:55.799768 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 18 10:32:55.799768 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 18 10:32:55.799768 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 18 10:32:55.799768 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance a3dbac58-662d-4720-8bcf-2300f9a9a5d1 while it is in vm_state rescued Jul 18 10:32:55.799768 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi Jul 18 10:32:55.799768 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:32:55.799768 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi Jul 18 10:32:55.799768 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:32:55.799768 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:32:55.799768 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:32:55.799768 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 10:32:55.799768 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 10:32:55.799768 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance a3dbac58-662d-4720-8bcf-2300f9a9a5d1 while it is in vm_state rescued Jul 18 10:32:55.799768 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi Jul 18 10:32:55.799768 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-6dd6ca3e-df75-47d1-abe9-3abc1f348857 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Returning 409 to user: Cannot 'detach_volume' instance a3dbac58-662d-4720-8bcf-2300f9a9a5d1 while it is in vm_state rescued {{(pid=117880) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 10:32:55.810264 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-6dd6ca3e-df75-47d1-abe9-3abc1f348857 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] 10.222.0.33 "DELETE /compute/v2.1/servers/a3dbac58-662d-4720-8bcf-2300f9a9a5d1/os-volume_attachments/763d6f81-f7c8-4a96-be85-5afcc42a6739" status: 409 len: 152 microversion: 2.1 time: 0.135975 Jul 18 10:32:55.810264 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 281/563] 10.222.0.33 () {58 vars in 1415 bytes} [Mon Jul 18 10:32:55 2022] DELETE /compute/v2.1/servers/a3dbac58-662d-4720-8bcf-2300f9a9a5d1/os-volume_attachments/763d6f81-f7c8-4a96-be85-5afcc42a6739 => generated 152 bytes in 150 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 18 10:32:55.820426 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-6c55a8b1-3b0a-4f18-ad69-a7d42a573fbc tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:32:55.820902 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-6c55a8b1-3b0a-4f18-ad69-a7d42a573fbc tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] [instance: a3dbac58-662d-4720-8bcf-2300f9a9a5d1] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:32:55.835533 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-6c55a8b1-3b0a-4f18-ad69-a7d42a573fbc tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:32:55.837571 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-6c55a8b1-3b0a-4f18-ad69-a7d42a573fbc tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:32:55.838583 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-6c55a8b1-3b0a-4f18-ad69-a7d42a573fbc tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:32:55.842400 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-6c55a8b1-3b0a-4f18-ad69-a7d42a573fbc tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:32:55.937649 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-6c55a8b1-3b0a-4f18-ad69-a7d42a573fbc tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] 10.222.0.33 "POST /compute/v2.1/servers/a3dbac58-662d-4720-8bcf-2300f9a9a5d1/action" status: 202 len: 0 microversion: 2.1 time: 0.120135 Jul 18 10:32:55.942832 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 282/564] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Jul 18 10:32:55 2022] POST /compute/v2.1/servers/a3dbac58-662d-4720-8bcf-2300f9a9a5d1/action => generated 0 bytes in 123 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 18 10:32:55.951058 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-3e41298a-3f1c-45e4-bad2-ec97d4307f2e tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:32:55.952165 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-3e41298a-3f1c-45e4-bad2-ec97d4307f2e tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] [instance: a3dbac58-662d-4720-8bcf-2300f9a9a5d1] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:32:55.965766 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-3e41298a-3f1c-45e4-bad2-ec97d4307f2e tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:32:55.967776 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-3e41298a-3f1c-45e4-bad2-ec97d4307f2e tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:32:55.968865 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-3e41298a-3f1c-45e4-bad2-ec97d4307f2e tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:32:55.969599 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-3e41298a-3f1c-45e4-bad2-ec97d4307f2e tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:32:56.202893 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-97c3f221-25ad-4c6a-8171-3fae9fe81fd4 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '986f90dfbad14324b3fffbd790d60a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e487deb7ff45bdbf2cc002d42d12a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:32:56.210492 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-97c3f221-25ad-4c6a-8171-3fae9fe81fd4 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] 10.222.0.33 "GET /compute/v2.1/servers/dcb1b50b-9e62-4ff3-9875-3d4635597b45" status: 200 len: 1675 microversion: 2.1 time: 0.438737 Jul 18 10:32:56.211069 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 283/565] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:32:55 2022] GET /compute/v2.1/servers/dcb1b50b-9e62-4ff3-9875-3d4635597b45 => generated 1675 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:32:56.223906 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-d23c5ceb-d7f1-4fdb-a4f2-c1eb2693eb5c tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:32:56.224576 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-d23c5ceb-d7f1-4fdb-a4f2-c1eb2693eb5c tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] [instance: 22a03003-3677-426e-8fb8-5b58998eef8a] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:32:56.231420 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-d23c5ceb-d7f1-4fdb-a4f2-c1eb2693eb5c tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:32:56.231879 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-d23c5ceb-d7f1-4fdb-a4f2-c1eb2693eb5c tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:32:56.232698 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-d23c5ceb-d7f1-4fdb-a4f2-c1eb2693eb5c tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:32:56.233147 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-d23c5ceb-d7f1-4fdb-a4f2-c1eb2693eb5c tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:32:56.539557 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-d23c5ceb-d7f1-4fdb-a4f2-c1eb2693eb5c tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9eb8d188e040bca894e038955f2402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c656b71bbd447cba7d11335c928dfda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:32:56.547438 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-d23c5ceb-d7f1-4fdb-a4f2-c1eb2693eb5c tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] 10.222.0.33 "GET /compute/v2.1/servers/22a03003-3677-426e-8fb8-5b58998eef8a" status: 200 len: 1210 microversion: 2.1 time: 0.334741 Jul 18 10:32:56.548007 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 284/566] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:32:56 2022] GET /compute/v2.1/servers/22a03003-3677-426e-8fb8-5b58998eef8a => generated 1210 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:32:56.560425 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-4db7b6e2-ad00-4a63-9c94-56e73ad1b59c tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:32:56.561064 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-4db7b6e2-ad00-4a63-9c94-56e73ad1b59c tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] [instance: 54754961-403d-4f99-98c1-727db8528d91] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:32:56.566815 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-4db7b6e2-ad00-4a63-9c94-56e73ad1b59c tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:32:56.567261 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-4db7b6e2-ad00-4a63-9c94-56e73ad1b59c tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:32:56.568022 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-4db7b6e2-ad00-4a63-9c94-56e73ad1b59c tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:32:56.568453 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-4db7b6e2-ad00-4a63-9c94-56e73ad1b59c tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:32:56.605283 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-3e41298a-3f1c-45e4-bad2-ec97d4307f2e tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a431c9708f4694bc0d514133e76088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a1921237622439bab89676e11477c13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:32:56.613716 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-3e41298a-3f1c-45e4-bad2-ec97d4307f2e tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] 10.222.0.33 "GET /compute/v2.1/servers/a3dbac58-662d-4720-8bcf-2300f9a9a5d1" status: 200 len: 1723 microversion: 2.1 time: 0.669319 Jul 18 10:32:56.614287 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 283/567] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:32:55 2022] GET /compute/v2.1/servers/a3dbac58-662d-4720-8bcf-2300f9a9a5d1 => generated 1723 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:32:56.736057 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [req-a8182926-4fe5-41e7-b79e-2e4890209a55 req-4af6f41b-1478-486e-8ef6-e5d9c5c2732c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "54754961-403d-4f99-98c1-727db8528d91", "tag": "ad0604e9-a3b4-440c-b590-c9d4898189de"}]} {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:32:56.745095 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [req-a8182926-4fe5-41e7-b79e-2e4890209a55 req-4af6f41b-1478-486e-8ef6-e5d9c5c2732c service nova] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:32:56.746006 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [req-a8182926-4fe5-41e7-b79e-2e4890209a55 req-4af6f41b-1478-486e-8ef6-e5d9c5c2732c service nova] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:32:56.757837 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.compute.server_external_events [req-a8182926-4fe5-41e7-b79e-2e4890209a55 req-4af6f41b-1478-486e-8ef6-e5d9c5c2732c service nova] Creating event network-changed:ad0604e9-a3b4-440c-b590-c9d4898189de for instance 54754961-403d-4f99-98c1-727db8528d91 on hv-cinder-83754 Jul 18 10:32:56.763702 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [req-a8182926-4fe5-41e7-b79e-2e4890209a55 req-4af6f41b-1478-486e-8ef6-e5d9c5c2732c service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032526 Jul 18 10:32:56.764863 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 284/568] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jul 18 10:32:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:32:56.847614 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-4db7b6e2-ad00-4a63-9c94-56e73ad1b59c tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f25c72896a2d4d619e5ad4b5a0a79aa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cf3d5bfe9a745f38372c42c9cfa1f63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:32:56.859297 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-4db7b6e2-ad00-4a63-9c94-56e73ad1b59c tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] 10.222.0.33 "GET /compute/v2.1/servers/54754961-403d-4f99-98c1-727db8528d91" status: 200 len: 1365 microversion: 2.1 time: 0.310178 Jul 18 10:32:56.860358 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 285/569] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:32:56 2022] GET /compute/v2.1/servers/54754961-403d-4f99-98c1-727db8528d91 => generated 1365 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:32:57.228373 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-1e6e0af2-fca7-4f14-8523-9634edee5afc tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:32:57.229126 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-1e6e0af2-fca7-4f14-8523-9634edee5afc tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] [instance: dcb1b50b-9e62-4ff3-9875-3d4635597b45] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:32:57.235392 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-1e6e0af2-fca7-4f14-8523-9634edee5afc tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:32:57.235848 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-1e6e0af2-fca7-4f14-8523-9634edee5afc tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:32:57.236651 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-1e6e0af2-fca7-4f14-8523-9634edee5afc tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:32:57.237095 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-1e6e0af2-fca7-4f14-8523-9634edee5afc tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:32:57.379938 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-1e6e0af2-fca7-4f14-8523-9634edee5afc tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '986f90dfbad14324b3fffbd790d60a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e487deb7ff45bdbf2cc002d42d12a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:32:57.387523 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-1e6e0af2-fca7-4f14-8523-9634edee5afc tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] 10.222.0.33 "GET /compute/v2.1/servers/dcb1b50b-9e62-4ff3-9875-3d4635597b45" status: 200 len: 1652 microversion: 2.1 time: 0.163645 Jul 18 10:32:57.388080 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 285/570] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:32:57 2022] GET /compute/v2.1/servers/dcb1b50b-9e62-4ff3-9875-3d4635597b45 => generated 1652 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:32:57.404329 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-0a9096d7-b88f-403d-84e2-b9d8475766cf tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:32:57.410948 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-0a9096d7-b88f-403d-84e2-b9d8475766cf tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:32:57.411406 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-0a9096d7-b88f-403d-84e2-b9d8475766cf tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:32:57.432683 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-0a9096d7-b88f-403d-84e2-b9d8475766cf tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] [instance: dcb1b50b-9e62-4ff3-9875-3d4635597b45] Going to try to start instance {{(pid=117879) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 18 10:32:57.473644 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-0a9096d7-b88f-403d-84e2-b9d8475766cf tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] 10.222.0.33 "POST /compute/v2.1/servers/dcb1b50b-9e62-4ff3-9875-3d4635597b45/action" status: 202 len: 0 microversion: 2.1 time: 0.073116 Jul 18 10:32:57.474236 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 286/571] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Jul 18 10:32:57 2022] POST /compute/v2.1/servers/dcb1b50b-9e62-4ff3-9875-3d4635597b45/action => generated 0 bytes in 75 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 10:32:57.482467 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-82d6b273-9167-4ded-8d1b-769ccf0f9297 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:32:57.483073 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-82d6b273-9167-4ded-8d1b-769ccf0f9297 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] [instance: dcb1b50b-9e62-4ff3-9875-3d4635597b45] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:32:57.489020 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-82d6b273-9167-4ded-8d1b-769ccf0f9297 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:32:57.489466 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-82d6b273-9167-4ded-8d1b-769ccf0f9297 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:32:57.490222 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-82d6b273-9167-4ded-8d1b-769ccf0f9297 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:32:57.490653 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-82d6b273-9167-4ded-8d1b-769ccf0f9297 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:32:57.565694 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-182d526f-ae40-40f5-a1fe-1282335e50d0 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:32:57.566779 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-182d526f-ae40-40f5-a1fe-1282335e50d0 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] [instance: 22a03003-3677-426e-8fb8-5b58998eef8a] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:32:57.573272 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-182d526f-ae40-40f5-a1fe-1282335e50d0 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:32:57.573726 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-182d526f-ae40-40f5-a1fe-1282335e50d0 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:32:57.574567 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-182d526f-ae40-40f5-a1fe-1282335e50d0 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:32:57.574934 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-182d526f-ae40-40f5-a1fe-1282335e50d0 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:32:57.651963 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-82d6b273-9167-4ded-8d1b-769ccf0f9297 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '986f90dfbad14324b3fffbd790d60a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e487deb7ff45bdbf2cc002d42d12a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:32:57.659970 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-82d6b273-9167-4ded-8d1b-769ccf0f9297 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] 10.222.0.33 "GET /compute/v2.1/servers/dcb1b50b-9e62-4ff3-9875-3d4635597b45" status: 200 len: 1661 microversion: 2.1 time: 0.181307 Jul 18 10:32:57.660558 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 286/572] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:32:57 2022] GET /compute/v2.1/servers/dcb1b50b-9e62-4ff3-9875-3d4635597b45 => generated 1661 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:32:57.664934 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-349d0f7c-3d18-44d7-838e-a36df3ea5029 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:32:57.665535 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-349d0f7c-3d18-44d7-838e-a36df3ea5029 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] [instance: a3dbac58-662d-4720-8bcf-2300f9a9a5d1] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:32:57.671417 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-349d0f7c-3d18-44d7-838e-a36df3ea5029 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:32:57.671875 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-349d0f7c-3d18-44d7-838e-a36df3ea5029 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:32:57.672669 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-349d0f7c-3d18-44d7-838e-a36df3ea5029 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:32:57.673105 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-349d0f7c-3d18-44d7-838e-a36df3ea5029 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:32:57.730048 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-182d526f-ae40-40f5-a1fe-1282335e50d0 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9eb8d188e040bca894e038955f2402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c656b71bbd447cba7d11335c928dfda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:32:57.737472 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-182d526f-ae40-40f5-a1fe-1282335e50d0 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] 10.222.0.33 "GET /compute/v2.1/servers/22a03003-3677-426e-8fb8-5b58998eef8a" status: 200 len: 1277 microversion: 2.1 time: 0.177142 Jul 18 10:32:57.738120 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 287/573] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:32:57 2022] GET /compute/v2.1/servers/22a03003-3677-426e-8fb8-5b58998eef8a => generated 1277 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:32:57.813816 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-349d0f7c-3d18-44d7-838e-a36df3ea5029 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a431c9708f4694bc0d514133e76088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a1921237622439bab89676e11477c13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:32:57.821790 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-349d0f7c-3d18-44d7-838e-a36df3ea5029 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] 10.222.0.33 "GET /compute/v2.1/servers/a3dbac58-662d-4720-8bcf-2300f9a9a5d1" status: 200 len: 1723 microversion: 2.1 time: 0.160295 Jul 18 10:32:57.822376 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 287/574] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:32:57 2022] GET /compute/v2.1/servers/a3dbac58-662d-4720-8bcf-2300f9a9a5d1 => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:32:57.876315 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-3058aabc-9e7c-499a-b1bc-53b765f50e2f tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:32:57.876955 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-3058aabc-9e7c-499a-b1bc-53b765f50e2f tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] [instance: 54754961-403d-4f99-98c1-727db8528d91] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:32:57.883493 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-3058aabc-9e7c-499a-b1bc-53b765f50e2f tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:32:57.883981 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-3058aabc-9e7c-499a-b1bc-53b765f50e2f tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:32:57.885140 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-3058aabc-9e7c-499a-b1bc-53b765f50e2f tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:32:57.885394 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-3058aabc-9e7c-499a-b1bc-53b765f50e2f tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:32:57.889949 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG dbcounter [-] [117879] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:32:58.031472 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-3058aabc-9e7c-499a-b1bc-53b765f50e2f tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f25c72896a2d4d619e5ad4b5a0a79aa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cf3d5bfe9a745f38372c42c9cfa1f63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:32:58.038913 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-3058aabc-9e7c-499a-b1bc-53b765f50e2f tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] 10.222.0.33 "GET /compute/v2.1/servers/54754961-403d-4f99-98c1-727db8528d91" status: 200 len: 1365 microversion: 2.1 time: 0.166379 Jul 18 10:32:58.039477 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 288/575] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:32:57 2022] GET /compute/v2.1/servers/54754961-403d-4f99-98c1-727db8528d91 => generated 1365 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:32:58.676952 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-4c7309f7-c401-4df1-af94-4d6de3c9e758 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:32:58.677590 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-4c7309f7-c401-4df1-af94-4d6de3c9e758 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] [instance: dcb1b50b-9e62-4ff3-9875-3d4635597b45] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:32:58.683541 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-4c7309f7-c401-4df1-af94-4d6de3c9e758 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:32:58.683990 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-4c7309f7-c401-4df1-af94-4d6de3c9e758 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:32:58.684768 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-4c7309f7-c401-4df1-af94-4d6de3c9e758 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:32:58.685200 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-4c7309f7-c401-4df1-af94-4d6de3c9e758 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:32:58.754074 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-b75e352b-346a-4211-bea4-da24d6b32d3f tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:32:58.754691 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-b75e352b-346a-4211-bea4-da24d6b32d3f tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] [instance: 22a03003-3677-426e-8fb8-5b58998eef8a] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:32:58.761714 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-b75e352b-346a-4211-bea4-da24d6b32d3f tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:32:58.762394 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-b75e352b-346a-4211-bea4-da24d6b32d3f tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:32:58.763171 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-b75e352b-346a-4211-bea4-da24d6b32d3f tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:32:58.763611 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-b75e352b-346a-4211-bea4-da24d6b32d3f tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:32:58.837646 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-4c7309f7-c401-4df1-af94-4d6de3c9e758 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '986f90dfbad14324b3fffbd790d60a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e487deb7ff45bdbf2cc002d42d12a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:32:58.845791 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-4c7309f7-c401-4df1-af94-4d6de3c9e758 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] 10.222.0.33 "GET /compute/v2.1/servers/dcb1b50b-9e62-4ff3-9875-3d4635597b45" status: 200 len: 1661 microversion: 2.1 time: 0.172656 Jul 18 10:32:58.846434 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 288/576] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:32:58 2022] GET /compute/v2.1/servers/dcb1b50b-9e62-4ff3-9875-3d4635597b45 => generated 1661 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:32:58.851674 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-2b827763-74a4-417c-9086-c55c8fb8155d tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:32:58.852341 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-2b827763-74a4-417c-9086-c55c8fb8155d tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] [instance: a3dbac58-662d-4720-8bcf-2300f9a9a5d1] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:32:58.858626 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-2b827763-74a4-417c-9086-c55c8fb8155d tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:32:58.859605 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-2b827763-74a4-417c-9086-c55c8fb8155d tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:32:58.860361 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-2b827763-74a4-417c-9086-c55c8fb8155d tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:32:58.860808 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-2b827763-74a4-417c-9086-c55c8fb8155d tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:32:58.937592 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-b75e352b-346a-4211-bea4-da24d6b32d3f tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9eb8d188e040bca894e038955f2402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c656b71bbd447cba7d11335c928dfda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:32:58.943695 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-b75e352b-346a-4211-bea4-da24d6b32d3f tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] 10.222.0.33 "GET /compute/v2.1/servers/22a03003-3677-426e-8fb8-5b58998eef8a" status: 200 len: 1277 microversion: 2.1 time: 0.193370 Jul 18 10:32:58.944303 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 289/577] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:32:58 2022] GET /compute/v2.1/servers/22a03003-3677-426e-8fb8-5b58998eef8a => generated 1277 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:32:59.056441 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-885e16ee-9255-4994-bbe8-18e472945e63 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:32:59.057123 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-885e16ee-9255-4994-bbe8-18e472945e63 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] [instance: 54754961-403d-4f99-98c1-727db8528d91] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:32:59.063921 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-885e16ee-9255-4994-bbe8-18e472945e63 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:32:59.064375 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-885e16ee-9255-4994-bbe8-18e472945e63 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:32:59.065182 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-885e16ee-9255-4994-bbe8-18e472945e63 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:32:59.065792 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-885e16ee-9255-4994-bbe8-18e472945e63 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:32:59.233450 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG dbcounter [-] [117879] Writing DB stats nova_cell0:SELECT=2 {{(pid=117879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:32:59.346330 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-2b827763-74a4-417c-9086-c55c8fb8155d tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a431c9708f4694bc0d514133e76088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a1921237622439bab89676e11477c13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:32:59.356690 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-2b827763-74a4-417c-9086-c55c8fb8155d tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] 10.222.0.33 "GET /compute/v2.1/servers/a3dbac58-662d-4720-8bcf-2300f9a9a5d1" status: 200 len: 1723 microversion: 2.1 time: 0.509145 Jul 18 10:32:59.357817 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 289/578] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:32:58 2022] GET /compute/v2.1/servers/a3dbac58-662d-4720-8bcf-2300f9a9a5d1 => generated 1723 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:32:59.575252 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-885e16ee-9255-4994-bbe8-18e472945e63 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f25c72896a2d4d619e5ad4b5a0a79aa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cf3d5bfe9a745f38372c42c9cfa1f63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:32:59.584120 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-885e16ee-9255-4994-bbe8-18e472945e63 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] 10.222.0.33 "GET /compute/v2.1/servers/54754961-403d-4f99-98c1-727db8528d91" status: 200 len: 1365 microversion: 2.1 time: 0.531446 Jul 18 10:32:59.585052 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 290/579] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:32:59 2022] GET /compute/v2.1/servers/54754961-403d-4f99-98c1-727db8528d91 => generated 1365 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:32:59.863281 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-1abec975-5e2f-4dca-9ca7-7931e50d3cd8 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:32:59.864060 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-1abec975-5e2f-4dca-9ca7-7931e50d3cd8 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] [instance: dcb1b50b-9e62-4ff3-9875-3d4635597b45] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:32:59.870782 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-1abec975-5e2f-4dca-9ca7-7931e50d3cd8 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:32:59.871356 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-1abec975-5e2f-4dca-9ca7-7931e50d3cd8 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:32:59.872234 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-1abec975-5e2f-4dca-9ca7-7931e50d3cd8 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:32:59.872810 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-1abec975-5e2f-4dca-9ca7-7931e50d3cd8 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:32:59.959794 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-ab59cf82-9b13-4069-9689-b75b8b31ebf4 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:32:59.960458 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-ab59cf82-9b13-4069-9689-b75b8b31ebf4 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] [instance: 22a03003-3677-426e-8fb8-5b58998eef8a] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:32:59.967416 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-ab59cf82-9b13-4069-9689-b75b8b31ebf4 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:32:59.967958 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-ab59cf82-9b13-4069-9689-b75b8b31ebf4 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:32:59.969958 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-ab59cf82-9b13-4069-9689-b75b8b31ebf4 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:32:59.970475 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-ab59cf82-9b13-4069-9689-b75b8b31ebf4 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:33:00.381748 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-1abec975-5e2f-4dca-9ca7-7931e50d3cd8 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '986f90dfbad14324b3fffbd790d60a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e487deb7ff45bdbf2cc002d42d12a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:33:00.395057 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-1abec975-5e2f-4dca-9ca7-7931e50d3cd8 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] 10.222.0.33 "GET /compute/v2.1/servers/dcb1b50b-9e62-4ff3-9875-3d4635597b45" status: 200 len: 1661 microversion: 2.1 time: 0.534131 Jul 18 10:33:00.405463 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 290/580] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:32:59 2022] GET /compute/v2.1/servers/dcb1b50b-9e62-4ff3-9875-3d4635597b45 => generated 1661 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:33:00.413453 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-8544b032-69bd-4b22-b401-fe0769595b20 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:33:00.414368 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-8544b032-69bd-4b22-b401-fe0769595b20 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] [instance: a3dbac58-662d-4720-8bcf-2300f9a9a5d1] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:33:00.423721 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-8544b032-69bd-4b22-b401-fe0769595b20 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:33:00.424491 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-8544b032-69bd-4b22-b401-fe0769595b20 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:33:00.425735 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-8544b032-69bd-4b22-b401-fe0769595b20 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:33:00.426382 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-8544b032-69bd-4b22-b401-fe0769595b20 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:33:00.461001 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-ab59cf82-9b13-4069-9689-b75b8b31ebf4 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9eb8d188e040bca894e038955f2402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c656b71bbd447cba7d11335c928dfda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:33:00.468637 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-ab59cf82-9b13-4069-9689-b75b8b31ebf4 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] 10.222.0.33 "GET /compute/v2.1/servers/22a03003-3677-426e-8fb8-5b58998eef8a" status: 200 len: 1265 microversion: 2.1 time: 0.512985 Jul 18 10:33:00.469345 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 291/581] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:32:59 2022] GET /compute/v2.1/servers/22a03003-3677-426e-8fb8-5b58998eef8a => generated 1265 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:33:00.601516 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-cad05c32-f327-4aa5-8d55-7b5dcffe4c49 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:33:00.602125 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-cad05c32-f327-4aa5-8d55-7b5dcffe4c49 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] [instance: 54754961-403d-4f99-98c1-727db8528d91] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:33:00.608241 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-cad05c32-f327-4aa5-8d55-7b5dcffe4c49 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:33:00.609231 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-cad05c32-f327-4aa5-8d55-7b5dcffe4c49 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:33:00.609992 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-cad05c32-f327-4aa5-8d55-7b5dcffe4c49 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:33:00.610421 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-cad05c32-f327-4aa5-8d55-7b5dcffe4c49 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:33:00.629262 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-8544b032-69bd-4b22-b401-fe0769595b20 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a431c9708f4694bc0d514133e76088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a1921237622439bab89676e11477c13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:33:00.639041 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-8544b032-69bd-4b22-b401-fe0769595b20 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] 10.222.0.33 "GET /compute/v2.1/servers/a3dbac58-662d-4720-8bcf-2300f9a9a5d1" status: 200 len: 1723 microversion: 2.1 time: 0.229862 Jul 18 10:33:00.651390 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 291/582] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:33:00 2022] GET /compute/v2.1/servers/a3dbac58-662d-4720-8bcf-2300f9a9a5d1 => generated 1723 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:33:01.097412 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [req-84959fc9-f231-40c4-8c14-5e405b3fd3d3 req-ae53bf71-0d7e-4ecc-bd96-0fa66455535a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "22a03003-3677-426e-8fb8-5b58998eef8a", "tag": "de125830-3de3-492c-bc45-25ee6ef36473"}]} {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:33:01.107900 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [req-84959fc9-f231-40c4-8c14-5e405b3fd3d3 req-ae53bf71-0d7e-4ecc-bd96-0fa66455535a service nova] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:33:01.108672 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [req-84959fc9-f231-40c4-8c14-5e405b3fd3d3 req-ae53bf71-0d7e-4ecc-bd96-0fa66455535a service nova] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:33:01.122911 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.compute.server_external_events [req-84959fc9-f231-40c4-8c14-5e405b3fd3d3 req-ae53bf71-0d7e-4ecc-bd96-0fa66455535a service nova] Creating event network-changed:de125830-3de3-492c-bc45-25ee6ef36473 for instance 22a03003-3677-426e-8fb8-5b58998eef8a on hv-cinder-83754 Jul 18 10:33:01.125153 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-cad05c32-f327-4aa5-8d55-7b5dcffe4c49 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f25c72896a2d4d619e5ad4b5a0a79aa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cf3d5bfe9a745f38372c42c9cfa1f63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:33:01.128990 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [req-84959fc9-f231-40c4-8c14-5e405b3fd3d3 req-ae53bf71-0d7e-4ecc-bd96-0fa66455535a service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036271 Jul 18 10:33:01.129709 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 292/583] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jul 18 10:33:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:33:01.137287 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-cad05c32-f327-4aa5-8d55-7b5dcffe4c49 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] 10.222.0.33 "GET /compute/v2.1/servers/54754961-403d-4f99-98c1-727db8528d91" status: 200 len: 1365 microversion: 2.1 time: 0.539684 Jul 18 10:33:01.149882 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 292/584] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:33:00 2022] GET /compute/v2.1/servers/54754961-403d-4f99-98c1-727db8528d91 => generated 1365 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:33:01.413306 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-696f7fcf-0bb8-41fa-ac44-535f714e49df tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:33:01.413988 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-696f7fcf-0bb8-41fa-ac44-535f714e49df tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] [instance: dcb1b50b-9e62-4ff3-9875-3d4635597b45] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:33:01.422016 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-696f7fcf-0bb8-41fa-ac44-535f714e49df tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:33:01.423712 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-696f7fcf-0bb8-41fa-ac44-535f714e49df tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:33:01.424491 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-696f7fcf-0bb8-41fa-ac44-535f714e49df tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:33:01.428555 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-696f7fcf-0bb8-41fa-ac44-535f714e49df tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:33:01.485974 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-1eea704d-38f8-4cb0-83dc-c7a375f780dc tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:33:01.486615 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-1eea704d-38f8-4cb0-83dc-c7a375f780dc tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] [instance: 22a03003-3677-426e-8fb8-5b58998eef8a] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:33:01.492563 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-1eea704d-38f8-4cb0-83dc-c7a375f780dc tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:33:01.492968 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-1eea704d-38f8-4cb0-83dc-c7a375f780dc tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:33:01.493740 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-1eea704d-38f8-4cb0-83dc-c7a375f780dc tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:33:01.494180 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-1eea704d-38f8-4cb0-83dc-c7a375f780dc tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:33:01.644651 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-696f7fcf-0bb8-41fa-ac44-535f714e49df tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '986f90dfbad14324b3fffbd790d60a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e487deb7ff45bdbf2cc002d42d12a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:33:01.653102 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-696f7fcf-0bb8-41fa-ac44-535f714e49df tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] 10.222.0.33 "GET /compute/v2.1/servers/dcb1b50b-9e62-4ff3-9875-3d4635597b45" status: 200 len: 1665 microversion: 2.1 time: 0.243696 Jul 18 10:33:01.654122 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 293/585] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:33:01 2022] GET /compute/v2.1/servers/dcb1b50b-9e62-4ff3-9875-3d4635597b45 => generated 1665 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:33:01.659346 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-cb14dfa0-2b6d-4c38-b2b2-59ee72bfc02b tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:33:01.659940 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-cb14dfa0-2b6d-4c38-b2b2-59ee72bfc02b tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] [instance: a3dbac58-662d-4720-8bcf-2300f9a9a5d1] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:33:01.666151 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-cb14dfa0-2b6d-4c38-b2b2-59ee72bfc02b tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:33:01.666619 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-cb14dfa0-2b6d-4c38-b2b2-59ee72bfc02b tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:33:01.667395 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-cb14dfa0-2b6d-4c38-b2b2-59ee72bfc02b tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:33:01.667818 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-cb14dfa0-2b6d-4c38-b2b2-59ee72bfc02b tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:33:01.682410 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-1eea704d-38f8-4cb0-83dc-c7a375f780dc tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9eb8d188e040bca894e038955f2402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c656b71bbd447cba7d11335c928dfda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:33:01.687190 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG dbcounter [-] [117880] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:33:01.691804 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-1eea704d-38f8-4cb0-83dc-c7a375f780dc tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] 10.222.0.33 "GET /compute/v2.1/servers/22a03003-3677-426e-8fb8-5b58998eef8a" status: 200 len: 1265 microversion: 2.1 time: 0.210065 Jul 18 10:33:01.692414 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 293/586] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:33:01 2022] GET /compute/v2.1/servers/22a03003-3677-426e-8fb8-5b58998eef8a => generated 1265 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:33:01.816998 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-cb14dfa0-2b6d-4c38-b2b2-59ee72bfc02b tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a431c9708f4694bc0d514133e76088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a1921237622439bab89676e11477c13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:33:01.825106 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-cb14dfa0-2b6d-4c38-b2b2-59ee72bfc02b tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] 10.222.0.33 "GET /compute/v2.1/servers/a3dbac58-662d-4720-8bcf-2300f9a9a5d1" status: 200 len: 1723 microversion: 2.1 time: 0.169884 Jul 18 10:33:01.825677 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 294/587] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:33:01 2022] GET /compute/v2.1/servers/a3dbac58-662d-4720-8bcf-2300f9a9a5d1 => generated 1723 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:33:02.156985 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-2ea35878-6fc0-4955-81ee-c1d37bb00c1d tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:33:02.158706 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-2ea35878-6fc0-4955-81ee-c1d37bb00c1d tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] [instance: 54754961-403d-4f99-98c1-727db8528d91] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:33:02.165227 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-2ea35878-6fc0-4955-81ee-c1d37bb00c1d tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:33:02.165679 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-2ea35878-6fc0-4955-81ee-c1d37bb00c1d tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:33:02.166446 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-2ea35878-6fc0-4955-81ee-c1d37bb00c1d tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:33:02.166884 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-2ea35878-6fc0-4955-81ee-c1d37bb00c1d tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:33:02.426013 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-2ea35878-6fc0-4955-81ee-c1d37bb00c1d tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f25c72896a2d4d619e5ad4b5a0a79aa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cf3d5bfe9a745f38372c42c9cfa1f63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:33:02.433384 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-2ea35878-6fc0-4955-81ee-c1d37bb00c1d tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] 10.222.0.33 "GET /compute/v2.1/servers/54754961-403d-4f99-98c1-727db8528d91" status: 200 len: 1365 microversion: 2.1 time: 0.280592 Jul 18 10:33:02.434170 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 294/588] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:33:02 2022] GET /compute/v2.1/servers/54754961-403d-4f99-98c1-727db8528d91 => generated 1365 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:33:02.713351 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-f1417a08-25cc-4651-916a-11d3cf618cde tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:33:02.714100 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-f1417a08-25cc-4651-916a-11d3cf618cde tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] [instance: 22a03003-3677-426e-8fb8-5b58998eef8a] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:33:02.720738 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-f1417a08-25cc-4651-916a-11d3cf618cde tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:33:02.721190 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-f1417a08-25cc-4651-916a-11d3cf618cde tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:33:02.721964 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-f1417a08-25cc-4651-916a-11d3cf618cde tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:33:02.722400 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-f1417a08-25cc-4651-916a-11d3cf618cde tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:33:02.842162 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-d64759a9-884d-4302-bfa9-e43a588d0c6f tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:33:02.843970 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-d64759a9-884d-4302-bfa9-e43a588d0c6f tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] [instance: a3dbac58-662d-4720-8bcf-2300f9a9a5d1] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:33:02.850928 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-d64759a9-884d-4302-bfa9-e43a588d0c6f tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:33:02.851352 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-d64759a9-884d-4302-bfa9-e43a588d0c6f tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:33:02.852168 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-d64759a9-884d-4302-bfa9-e43a588d0c6f tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:33:02.853073 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-d64759a9-884d-4302-bfa9-e43a588d0c6f tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:33:02.981245 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-f1417a08-25cc-4651-916a-11d3cf618cde tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9eb8d188e040bca894e038955f2402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c656b71bbd447cba7d11335c928dfda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:33:02.989981 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-f1417a08-25cc-4651-916a-11d3cf618cde tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] 10.222.0.33 "GET /compute/v2.1/servers/22a03003-3677-426e-8fb8-5b58998eef8a" status: 200 len: 1265 microversion: 2.1 time: 0.280720 Jul 18 10:33:02.990556 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 295/589] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:33:02 2022] GET /compute/v2.1/servers/22a03003-3677-426e-8fb8-5b58998eef8a => generated 1265 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:33:03.029157 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-d64759a9-884d-4302-bfa9-e43a588d0c6f tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a431c9708f4694bc0d514133e76088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a1921237622439bab89676e11477c13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:33:03.037082 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-d64759a9-884d-4302-bfa9-e43a588d0c6f tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] 10.222.0.33 "GET /compute/v2.1/servers/a3dbac58-662d-4720-8bcf-2300f9a9a5d1" status: 200 len: 1729 microversion: 2.1 time: 0.199095 Jul 18 10:33:03.037644 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 295/590] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:33:02 2022] GET /compute/v2.1/servers/a3dbac58-662d-4720-8bcf-2300f9a9a5d1 => generated 1729 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:33:03.053643 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-d3c95e8a-9f05-4e85-8b61-679792cc323e tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:33:03.054107 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-d3c95e8a-9f05-4e85-8b61-679792cc323e tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] [instance: a3dbac58-662d-4720-8bcf-2300f9a9a5d1] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:33:03.060019 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-d3c95e8a-9f05-4e85-8b61-679792cc323e tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:33:03.060465 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-d3c95e8a-9f05-4e85-8b61-679792cc323e tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:33:03.061248 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-d3c95e8a-9f05-4e85-8b61-679792cc323e tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:33:03.061673 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-d3c95e8a-9f05-4e85-8b61-679792cc323e tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:33:03.142435 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-d3c95e8a-9f05-4e85-8b61-679792cc323e tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] 10.222.0.33 "GET /compute/v2.1/servers/a3dbac58-662d-4720-8bcf-2300f9a9a5d1/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.092528 Jul 18 10:33:03.143017 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 296/591] 10.222.0.33 () {58 vars in 1274 bytes} [Mon Jul 18 10:33:03 2022] GET /compute/v2.1/servers/a3dbac58-662d-4720-8bcf-2300f9a9a5d1/os-interface => generated 284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:33:03.451061 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-ac204e14-cd7e-47e1-98b5-dfdfb53cfb32 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:33:03.451607 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-ac204e14-cd7e-47e1-98b5-dfdfb53cfb32 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] [instance: 54754961-403d-4f99-98c1-727db8528d91] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:33:03.457843 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-ac204e14-cd7e-47e1-98b5-dfdfb53cfb32 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:33:03.458289 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-ac204e14-cd7e-47e1-98b5-dfdfb53cfb32 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:33:03.459053 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-ac204e14-cd7e-47e1-98b5-dfdfb53cfb32 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:33:03.459486 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-ac204e14-cd7e-47e1-98b5-dfdfb53cfb32 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:33:03.716924 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-ac204e14-cd7e-47e1-98b5-dfdfb53cfb32 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f25c72896a2d4d619e5ad4b5a0a79aa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cf3d5bfe9a745f38372c42c9cfa1f63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:33:03.725757 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-ac204e14-cd7e-47e1-98b5-dfdfb53cfb32 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] 10.222.0.33 "GET /compute/v2.1/servers/54754961-403d-4f99-98c1-727db8528d91" status: 200 len: 1365 microversion: 2.1 time: 0.278472 Jul 18 10:33:03.726404 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 296/592] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:33:03 2022] GET /compute/v2.1/servers/54754961-403d-4f99-98c1-727db8528d91 => generated 1365 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:33:04.003503 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG dbcounter [-] [117880] Writing DB stats nova_cell0:SELECT=2 {{(pid=117880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:33:04.004582 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG dbcounter [-] [117880] Writing DB stats nova_cell0:SELECT=10 {{(pid=117880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:33:04.009349 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-e6221876-476a-4921-91df-c315bfd9dd55 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:33:04.010036 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-e6221876-476a-4921-91df-c315bfd9dd55 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] [instance: 22a03003-3677-426e-8fb8-5b58998eef8a] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:33:04.018128 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-e6221876-476a-4921-91df-c315bfd9dd55 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:33:04.018657 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-e6221876-476a-4921-91df-c315bfd9dd55 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:33:04.019513 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-e6221876-476a-4921-91df-c315bfd9dd55 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:33:04.020011 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-e6221876-476a-4921-91df-c315bfd9dd55 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:33:04.333914 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-e6221876-476a-4921-91df-c315bfd9dd55 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9eb8d188e040bca894e038955f2402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c656b71bbd447cba7d11335c928dfda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:33:04.341374 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-e6221876-476a-4921-91df-c315bfd9dd55 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] 10.222.0.33 "GET /compute/v2.1/servers/22a03003-3677-426e-8fb8-5b58998eef8a" status: 200 len: 1265 microversion: 2.1 time: 0.338652 Jul 18 10:33:04.341944 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 297/593] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:33:04 2022] GET /compute/v2.1/servers/22a03003-3677-426e-8fb8-5b58998eef8a => generated 1265 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:33:04.462797 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [req-ffa4589d-c465-4301-b94a-340ec918bd88 req-de6921f9-cad3-4542-a820-b0e5c3ae7510 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a3dbac58-662d-4720-8bcf-2300f9a9a5d1", "tag": "280c18f2-df08-4a5c-a1cc-01a91c5d3cfb"}]} {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:33:04.476954 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG dbcounter [-] [117879] Writing DB stats nova_cell0:SELECT=10 {{(pid=117879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:33:04.483696 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [req-ffa4589d-c465-4301-b94a-340ec918bd88 req-de6921f9-cad3-4542-a820-b0e5c3ae7510 service nova] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:33:04.484138 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [req-ffa4589d-c465-4301-b94a-340ec918bd88 req-de6921f9-cad3-4542-a820-b0e5c3ae7510 service nova] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:33:04.500296 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.compute.server_external_events [req-ffa4589d-c465-4301-b94a-340ec918bd88 req-de6921f9-cad3-4542-a820-b0e5c3ae7510 service nova] Creating event network-changed:280c18f2-df08-4a5c-a1cc-01a91c5d3cfb for instance a3dbac58-662d-4720-8bcf-2300f9a9a5d1 on hv-cinder-83754 Jul 18 10:33:04.505373 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [req-ffa4589d-c465-4301-b94a-340ec918bd88 req-de6921f9-cad3-4542-a820-b0e5c3ae7510 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046097 Jul 18 10:33:04.505971 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 297/594] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jul 18 10:33:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:33:04.743050 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-5814ddef-3762-4889-a8ea-ce7cf14e1601 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:33:04.743737 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-5814ddef-3762-4889-a8ea-ce7cf14e1601 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] [instance: 54754961-403d-4f99-98c1-727db8528d91] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:33:04.750212 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-5814ddef-3762-4889-a8ea-ce7cf14e1601 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:33:04.750657 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-5814ddef-3762-4889-a8ea-ce7cf14e1601 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:33:04.751615 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-5814ddef-3762-4889-a8ea-ce7cf14e1601 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:33:04.753227 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-5814ddef-3762-4889-a8ea-ce7cf14e1601 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:33:04.970336 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-5814ddef-3762-4889-a8ea-ce7cf14e1601 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f25c72896a2d4d619e5ad4b5a0a79aa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cf3d5bfe9a745f38372c42c9cfa1f63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:33:04.980887 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-5814ddef-3762-4889-a8ea-ce7cf14e1601 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] 10.222.0.33 "GET /compute/v2.1/servers/54754961-403d-4f99-98c1-727db8528d91" status: 200 len: 1365 microversion: 2.1 time: 0.241591 Jul 18 10:33:04.992100 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 298/595] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:33:04 2022] GET /compute/v2.1/servers/54754961-403d-4f99-98c1-727db8528d91 => generated 1365 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:33:05.360177 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-e1753201-416b-43d2-9232-388798ef6fc2 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:33:05.361127 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-e1753201-416b-43d2-9232-388798ef6fc2 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] [instance: 22a03003-3677-426e-8fb8-5b58998eef8a] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:33:05.372209 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-e1753201-416b-43d2-9232-388798ef6fc2 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:33:05.373218 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-e1753201-416b-43d2-9232-388798ef6fc2 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:33:05.374825 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-e1753201-416b-43d2-9232-388798ef6fc2 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:33:05.375665 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-e1753201-416b-43d2-9232-388798ef6fc2 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:33:05.610971 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-e1753201-416b-43d2-9232-388798ef6fc2 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9eb8d188e040bca894e038955f2402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c656b71bbd447cba7d11335c928dfda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:33:05.618572 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-e1753201-416b-43d2-9232-388798ef6fc2 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] 10.222.0.33 "GET /compute/v2.1/servers/22a03003-3677-426e-8fb8-5b58998eef8a" status: 200 len: 1265 microversion: 2.1 time: 0.263620 Jul 18 10:33:05.619154 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 298/596] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:33:05 2022] GET /compute/v2.1/servers/22a03003-3677-426e-8fb8-5b58998eef8a => generated 1265 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:33:05.998343 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-601f3567-979e-4d62-924a-0c62760315fd tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:33:05.998958 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-601f3567-979e-4d62-924a-0c62760315fd tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] [instance: 54754961-403d-4f99-98c1-727db8528d91] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:33:06.005423 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-601f3567-979e-4d62-924a-0c62760315fd tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:33:06.005868 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-601f3567-979e-4d62-924a-0c62760315fd tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:33:06.006632 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-601f3567-979e-4d62-924a-0c62760315fd tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:33:06.007079 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-601f3567-979e-4d62-924a-0c62760315fd tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:33:06.147971 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-601f3567-979e-4d62-924a-0c62760315fd tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f25c72896a2d4d619e5ad4b5a0a79aa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cf3d5bfe9a745f38372c42c9cfa1f63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:33:06.156065 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-601f3567-979e-4d62-924a-0c62760315fd tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] 10.222.0.33 "GET /compute/v2.1/servers/54754961-403d-4f99-98c1-727db8528d91" status: 200 len: 1365 microversion: 2.1 time: 0.160892 Jul 18 10:33:06.156673 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 299/597] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:33:05 2022] GET /compute/v2.1/servers/54754961-403d-4f99-98c1-727db8528d91 => generated 1365 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:33:06.520644 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [req-6ae390fa-8d32-4e7c-9cc2-d9a2d854572e req-0ef1b045-bf59-4b6a-a929-f060b9ffae0f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a3dbac58-662d-4720-8bcf-2300f9a9a5d1", "tag": "280c18f2-df08-4a5c-a1cc-01a91c5d3cfb"}]} {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:33:06.528963 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [req-6ae390fa-8d32-4e7c-9cc2-d9a2d854572e req-0ef1b045-bf59-4b6a-a929-f060b9ffae0f service nova] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:33:06.529407 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [req-6ae390fa-8d32-4e7c-9cc2-d9a2d854572e req-0ef1b045-bf59-4b6a-a929-f060b9ffae0f service nova] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:33:06.540084 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.compute.server_external_events [req-6ae390fa-8d32-4e7c-9cc2-d9a2d854572e req-0ef1b045-bf59-4b6a-a929-f060b9ffae0f service nova] Creating event network-changed:280c18f2-df08-4a5c-a1cc-01a91c5d3cfb for instance a3dbac58-662d-4720-8bcf-2300f9a9a5d1 on hv-cinder-83754 Jul 18 10:33:06.545007 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [req-6ae390fa-8d32-4e7c-9cc2-d9a2d854572e req-0ef1b045-bf59-4b6a-a929-f060b9ffae0f service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.027967 Jul 18 10:33:06.545684 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 299/598] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jul 18 10:33:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:33:06.635034 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-e9264095-220b-4f55-a1e4-6eff8b87e4ff tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:33:06.635666 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-e9264095-220b-4f55-a1e4-6eff8b87e4ff tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] [instance: 22a03003-3677-426e-8fb8-5b58998eef8a] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:33:06.642213 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-e9264095-220b-4f55-a1e4-6eff8b87e4ff tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:33:06.642662 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-e9264095-220b-4f55-a1e4-6eff8b87e4ff tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:33:06.643418 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-e9264095-220b-4f55-a1e4-6eff8b87e4ff tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:33:06.643849 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-e9264095-220b-4f55-a1e4-6eff8b87e4ff tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:33:06.840378 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-e9264095-220b-4f55-a1e4-6eff8b87e4ff tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9eb8d188e040bca894e038955f2402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c656b71bbd447cba7d11335c928dfda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:33:06.848477 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-e9264095-220b-4f55-a1e4-6eff8b87e4ff tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] 10.222.0.33 "GET /compute/v2.1/servers/22a03003-3677-426e-8fb8-5b58998eef8a" status: 200 len: 1265 microversion: 2.1 time: 0.217240 Jul 18 10:33:06.849063 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 300/599] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:33:06 2022] GET /compute/v2.1/servers/22a03003-3677-426e-8fb8-5b58998eef8a => generated 1265 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:33:07.057480 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [req-2e8e0f40-2df5-4195-97ac-3cb13eae0479 req-3815fb4f-a792-4747-a390-3212be28b605 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "54754961-403d-4f99-98c1-727db8528d91", "name": "network-vif-plugged", "status": "completed", "tag": "ad0604e9-a3b4-440c-b590-c9d4898189de"}]} {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:33:07.066140 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [req-2e8e0f40-2df5-4195-97ac-3cb13eae0479 req-3815fb4f-a792-4747-a390-3212be28b605 service nova] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:33:07.066787 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [req-2e8e0f40-2df5-4195-97ac-3cb13eae0479 req-3815fb4f-a792-4747-a390-3212be28b605 service nova] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:33:07.079526 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.compute.server_external_events [req-2e8e0f40-2df5-4195-97ac-3cb13eae0479 req-3815fb4f-a792-4747-a390-3212be28b605 service nova] Creating event network-vif-plugged:ad0604e9-a3b4-440c-b590-c9d4898189de for instance 54754961-403d-4f99-98c1-727db8528d91 on hv-cinder-83754 Jul 18 10:33:07.084542 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [req-2e8e0f40-2df5-4195-97ac-3cb13eae0479 req-3815fb4f-a792-4747-a390-3212be28b605 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031400 Jul 18 10:33:07.085337 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 300/600] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jul 18 10:33:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 10:33:07.179034 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-c182e60c-f72f-40c7-9452-209c3e74d03d tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:33:07.179638 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-c182e60c-f72f-40c7-9452-209c3e74d03d tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] [instance: 54754961-403d-4f99-98c1-727db8528d91] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:33:07.186887 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-c182e60c-f72f-40c7-9452-209c3e74d03d tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:33:07.187545 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-c182e60c-f72f-40c7-9452-209c3e74d03d tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:33:07.188319 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-c182e60c-f72f-40c7-9452-209c3e74d03d tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:33:07.188782 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-c182e60c-f72f-40c7-9452-209c3e74d03d tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:33:07.398741 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-c182e60c-f72f-40c7-9452-209c3e74d03d tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f25c72896a2d4d619e5ad4b5a0a79aa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cf3d5bfe9a745f38372c42c9cfa1f63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:33:07.407719 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-c182e60c-f72f-40c7-9452-209c3e74d03d tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] 10.222.0.33 "GET /compute/v2.1/servers/54754961-403d-4f99-98c1-727db8528d91" status: 200 len: 1365 microversion: 2.1 time: 0.232260 Jul 18 10:33:07.413144 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 301/601] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:33:07 2022] GET /compute/v2.1/servers/54754961-403d-4f99-98c1-727db8528d91 => generated 1365 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:33:07.866543 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-e42482c1-8cee-4a7f-8227-76d5f2fb42d7 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:33:07.867235 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-e42482c1-8cee-4a7f-8227-76d5f2fb42d7 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] [instance: 22a03003-3677-426e-8fb8-5b58998eef8a] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:33:07.873387 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-e42482c1-8cee-4a7f-8227-76d5f2fb42d7 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:33:07.873840 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-e42482c1-8cee-4a7f-8227-76d5f2fb42d7 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:33:07.874599 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-e42482c1-8cee-4a7f-8227-76d5f2fb42d7 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:33:07.875039 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-e42482c1-8cee-4a7f-8227-76d5f2fb42d7 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:33:08.004129 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-e42482c1-8cee-4a7f-8227-76d5f2fb42d7 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9eb8d188e040bca894e038955f2402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c656b71bbd447cba7d11335c928dfda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:33:08.011500 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-e42482c1-8cee-4a7f-8227-76d5f2fb42d7 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] 10.222.0.33 "GET /compute/v2.1/servers/22a03003-3677-426e-8fb8-5b58998eef8a" status: 200 len: 1265 microversion: 2.1 time: 0.149558 Jul 18 10:33:08.012044 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 301/602] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:33:07 2022] GET /compute/v2.1/servers/22a03003-3677-426e-8fb8-5b58998eef8a => generated 1265 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:33:08.425501 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-61246e89-1102-4984-8ba0-c76587f029a8 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:33:08.426102 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-61246e89-1102-4984-8ba0-c76587f029a8 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] [instance: 54754961-403d-4f99-98c1-727db8528d91] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:33:08.432401 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-61246e89-1102-4984-8ba0-c76587f029a8 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:33:08.432876 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-61246e89-1102-4984-8ba0-c76587f029a8 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:33:08.433632 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-61246e89-1102-4984-8ba0-c76587f029a8 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:33:08.434060 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-61246e89-1102-4984-8ba0-c76587f029a8 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:33:08.579470 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-61246e89-1102-4984-8ba0-c76587f029a8 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f25c72896a2d4d619e5ad4b5a0a79aa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cf3d5bfe9a745f38372c42c9cfa1f63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:33:08.587116 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-61246e89-1102-4984-8ba0-c76587f029a8 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] 10.222.0.33 "GET /compute/v2.1/servers/54754961-403d-4f99-98c1-727db8528d91" status: 200 len: 1365 microversion: 2.1 time: 0.166079 Jul 18 10:33:08.587672 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 302/603] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:33:08 2022] GET /compute/v2.1/servers/54754961-403d-4f99-98c1-727db8528d91 => generated 1365 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:33:09.029420 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-7c8ac17b-71d4-4593-8978-b39f955c627a tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:33:09.030008 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-7c8ac17b-71d4-4593-8978-b39f955c627a tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] [instance: 22a03003-3677-426e-8fb8-5b58998eef8a] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:33:09.037090 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-7c8ac17b-71d4-4593-8978-b39f955c627a tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:33:09.037549 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-7c8ac17b-71d4-4593-8978-b39f955c627a tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:33:09.038307 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-7c8ac17b-71d4-4593-8978-b39f955c627a tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:33:09.038744 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-7c8ac17b-71d4-4593-8978-b39f955c627a tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:33:09.176604 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-7c8ac17b-71d4-4593-8978-b39f955c627a tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9eb8d188e040bca894e038955f2402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c656b71bbd447cba7d11335c928dfda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:33:09.184032 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-7c8ac17b-71d4-4593-8978-b39f955c627a tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] 10.222.0.33 "GET /compute/v2.1/servers/22a03003-3677-426e-8fb8-5b58998eef8a" status: 200 len: 1265 microversion: 2.1 time: 0.158455 Jul 18 10:33:09.184699 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 302/604] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:33:09 2022] GET /compute/v2.1/servers/22a03003-3677-426e-8fb8-5b58998eef8a => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:33:09.604495 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-8ed6207f-2bd1-499e-8f37-17e050f44d8a tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:33:09.605216 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-8ed6207f-2bd1-499e-8f37-17e050f44d8a tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] [instance: 54754961-403d-4f99-98c1-727db8528d91] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:33:09.612249 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-8ed6207f-2bd1-499e-8f37-17e050f44d8a tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:33:09.612801 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-8ed6207f-2bd1-499e-8f37-17e050f44d8a tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:33:09.613571 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-8ed6207f-2bd1-499e-8f37-17e050f44d8a tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:33:09.614005 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-8ed6207f-2bd1-499e-8f37-17e050f44d8a tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:33:09.746320 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-8ed6207f-2bd1-499e-8f37-17e050f44d8a tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f25c72896a2d4d619e5ad4b5a0a79aa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cf3d5bfe9a745f38372c42c9cfa1f63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:33:09.754325 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-8ed6207f-2bd1-499e-8f37-17e050f44d8a tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] 10.222.0.33 "GET /compute/v2.1/servers/54754961-403d-4f99-98c1-727db8528d91" status: 200 len: 1556 microversion: 2.1 time: 0.153869 Jul 18 10:33:09.765978 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 303/605] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:33:09 2022] GET /compute/v2.1/servers/54754961-403d-4f99-98c1-727db8528d91 => generated 1556 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:33:09.771786 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-61f6f051-46c4-4427-a8ba-06b6621ab053 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:33:09.772664 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-61f6f051-46c4-4427-a8ba-06b6621ab053 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] [instance: 54754961-403d-4f99-98c1-727db8528d91] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:33:09.778833 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-61f6f051-46c4-4427-a8ba-06b6621ab053 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:33:09.779291 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-61f6f051-46c4-4427-a8ba-06b6621ab053 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:33:09.780060 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-61f6f051-46c4-4427-a8ba-06b6621ab053 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:33:09.781260 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-61f6f051-46c4-4427-a8ba-06b6621ab053 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:33:09.869258 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-61f6f051-46c4-4427-a8ba-06b6621ab053 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] 10.222.0.33 "GET /compute/v2.1/servers/54754961-403d-4f99-98c1-727db8528d91/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.101926 Jul 18 10:33:09.870030 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 303/606] 10.222.0.33 () {58 vars in 1274 bytes} [Mon Jul 18 10:33:09 2022] GET /compute/v2.1/servers/54754961-403d-4f99-98c1-727db8528d91/os-interface => generated 285 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:33:10.201153 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-8e380f2c-f3c1-4cd4-b4e0-d6fcbe335e23 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:33:10.201997 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-8e380f2c-f3c1-4cd4-b4e0-d6fcbe335e23 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] [instance: 22a03003-3677-426e-8fb8-5b58998eef8a] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:33:10.208712 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-8e380f2c-f3c1-4cd4-b4e0-d6fcbe335e23 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:33:10.209166 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-8e380f2c-f3c1-4cd4-b4e0-d6fcbe335e23 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:33:10.209932 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-8e380f2c-f3c1-4cd4-b4e0-d6fcbe335e23 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:33:10.210371 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-8e380f2c-f3c1-4cd4-b4e0-d6fcbe335e23 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:33:10.440801 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-8e380f2c-f3c1-4cd4-b4e0-d6fcbe335e23 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9eb8d188e040bca894e038955f2402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c656b71bbd447cba7d11335c928dfda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:33:10.449419 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-8e380f2c-f3c1-4cd4-b4e0-d6fcbe335e23 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] 10.222.0.33 "GET /compute/v2.1/servers/22a03003-3677-426e-8fb8-5b58998eef8a" status: 200 len: 1265 microversion: 2.1 time: 0.251973 Jul 18 10:33:10.450438 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 304/607] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:33:10 2022] GET /compute/v2.1/servers/22a03003-3677-426e-8fb8-5b58998eef8a => generated 1265 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:33:10.916223 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [req-5da6aeff-14d0-4cee-81d4-689ff18a9367 req-cb87a897-d568-406b-af98-905d6832a337 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "54754961-403d-4f99-98c1-727db8528d91", "tag": "ad0604e9-a3b4-440c-b590-c9d4898189de"}]} {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:33:10.924833 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [req-5da6aeff-14d0-4cee-81d4-689ff18a9367 req-cb87a897-d568-406b-af98-905d6832a337 service nova] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:33:10.925283 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [req-5da6aeff-14d0-4cee-81d4-689ff18a9367 req-cb87a897-d568-406b-af98-905d6832a337 service nova] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:33:10.936842 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.compute.server_external_events [req-5da6aeff-14d0-4cee-81d4-689ff18a9367 req-cb87a897-d568-406b-af98-905d6832a337 service nova] Creating event network-changed:ad0604e9-a3b4-440c-b590-c9d4898189de for instance 54754961-403d-4f99-98c1-727db8528d91 on hv-cinder-83754 Jul 18 10:33:10.944003 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [req-5da6aeff-14d0-4cee-81d4-689ff18a9367 req-cb87a897-d568-406b-af98-905d6832a337 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031743 Jul 18 10:33:10.944530 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 304/608] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jul 18 10:33:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:33:11.466945 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-91b5906e-64b7-4b7d-9e07-8127891daa07 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:33:11.474596 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-91b5906e-64b7-4b7d-9e07-8127891daa07 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] [instance: 22a03003-3677-426e-8fb8-5b58998eef8a] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:33:11.482049 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-91b5906e-64b7-4b7d-9e07-8127891daa07 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:33:11.485526 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-91b5906e-64b7-4b7d-9e07-8127891daa07 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:33:11.491197 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-91b5906e-64b7-4b7d-9e07-8127891daa07 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:33:11.491982 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-91b5906e-64b7-4b7d-9e07-8127891daa07 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:33:11.637737 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-91b5906e-64b7-4b7d-9e07-8127891daa07 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9eb8d188e040bca894e038955f2402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c656b71bbd447cba7d11335c928dfda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:33:11.645779 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-91b5906e-64b7-4b7d-9e07-8127891daa07 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] 10.222.0.33 "GET /compute/v2.1/servers/22a03003-3677-426e-8fb8-5b58998eef8a" status: 200 len: 1265 microversion: 2.1 time: 0.182622 Jul 18 10:33:11.646350 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 305/609] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:33:11 2022] GET /compute/v2.1/servers/22a03003-3677-426e-8fb8-5b58998eef8a => generated 1265 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:33:12.422613 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-6d862a50-9d01-4b8e-a178-eda087946096 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:33:12.423638 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-6d862a50-9d01-4b8e-a178-eda087946096 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] [instance: 83b29c39-45ca-4cb3-ad7d-f7bd47bfe667] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:33:12.429819 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-6d862a50-9d01-4b8e-a178-eda087946096 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:33:12.430269 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-6d862a50-9d01-4b8e-a178-eda087946096 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:33:12.431026 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-6d862a50-9d01-4b8e-a178-eda087946096 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:33:12.431466 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-6d862a50-9d01-4b8e-a178-eda087946096 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:33:12.500159 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-6d862a50-9d01-4b8e-a178-eda087946096 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] 10.222.0.33 "POST /compute/v2.1/servers/83b29c39-45ca-4cb3-ad7d-f7bd47bfe667/action" status: 202 len: 0 microversion: 2.1 time: 0.082689 Jul 18 10:33:12.500868 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 305/610] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Jul 18 10:33:12 2022] POST /compute/v2.1/servers/83b29c39-45ca-4cb3-ad7d-f7bd47bfe667/action => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 10:33:12.508894 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-9aee3474-bf9c-457b-a7e6-c53c38783a58 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:33:12.509503 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-9aee3474-bf9c-457b-a7e6-c53c38783a58 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] [instance: 83b29c39-45ca-4cb3-ad7d-f7bd47bfe667] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:33:12.516119 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-9aee3474-bf9c-457b-a7e6-c53c38783a58 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:33:12.516602 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-9aee3474-bf9c-457b-a7e6-c53c38783a58 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:33:12.517517 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-9aee3474-bf9c-457b-a7e6-c53c38783a58 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:33:12.518236 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-9aee3474-bf9c-457b-a7e6-c53c38783a58 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:33:12.662984 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-4759c368-c006-4199-bf9b-14d4719929a8 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:33:12.663681 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-4759c368-c006-4199-bf9b-14d4719929a8 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] [instance: 22a03003-3677-426e-8fb8-5b58998eef8a] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:33:12.669811 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-4759c368-c006-4199-bf9b-14d4719929a8 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:33:12.670265 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-4759c368-c006-4199-bf9b-14d4719929a8 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:33:12.671051 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-4759c368-c006-4199-bf9b-14d4719929a8 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:33:12.671496 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-4759c368-c006-4199-bf9b-14d4719929a8 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:33:12.785666 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-9aee3474-bf9c-457b-a7e6-c53c38783a58 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af30265de71409d876112350949a2a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f62ef510c8484995a2f31f29104f399f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:33:12.793631 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-9aee3474-bf9c-457b-a7e6-c53c38783a58 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] 10.222.0.33 "GET /compute/v2.1/servers/83b29c39-45ca-4cb3-ad7d-f7bd47bfe667" status: 200 len: 1752 microversion: 2.1 time: 0.288496 Jul 18 10:33:12.794386 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 306/611] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:33:12 2022] GET /compute/v2.1/servers/83b29c39-45ca-4cb3-ad7d-f7bd47bfe667 => generated 1752 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:33:12.893684 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-4759c368-c006-4199-bf9b-14d4719929a8 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9eb8d188e040bca894e038955f2402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c656b71bbd447cba7d11335c928dfda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:33:12.897227 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG dbcounter [-] [117879] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:33:12.902934 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-4759c368-c006-4199-bf9b-14d4719929a8 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] 10.222.0.33 "GET /compute/v2.1/servers/22a03003-3677-426e-8fb8-5b58998eef8a" status: 200 len: 1265 microversion: 2.1 time: 0.244161 Jul 18 10:33:12.903503 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 306/612] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:33:12 2022] GET /compute/v2.1/servers/22a03003-3677-426e-8fb8-5b58998eef8a => generated 1265 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:33:13.128583 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [req-bd06bd91-b52d-45f3-99b0-59c6870fab39 req-64902fd8-048f-4413-a33c-d8174d1b8943 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22a03003-3677-426e-8fb8-5b58998eef8a", "name": "network-vif-plugged", "status": "completed", "tag": "de125830-3de3-492c-bc45-25ee6ef36473"}]} {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:33:13.137191 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [req-bd06bd91-b52d-45f3-99b0-59c6870fab39 req-64902fd8-048f-4413-a33c-d8174d1b8943 service nova] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:33:13.137720 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [req-bd06bd91-b52d-45f3-99b0-59c6870fab39 req-64902fd8-048f-4413-a33c-d8174d1b8943 service nova] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:33:13.150740 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.compute.server_external_events [req-bd06bd91-b52d-45f3-99b0-59c6870fab39 req-64902fd8-048f-4413-a33c-d8174d1b8943 service nova] Creating event network-vif-plugged:de125830-3de3-492c-bc45-25ee6ef36473 for instance 22a03003-3677-426e-8fb8-5b58998eef8a on hv-cinder-83754 Jul 18 10:33:13.159107 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [req-bd06bd91-b52d-45f3-99b0-59c6870fab39 req-64902fd8-048f-4413-a33c-d8174d1b8943 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035038 Jul 18 10:33:13.160130 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 307/613] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jul 18 10:33:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:33:13.811852 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-c8e2d638-d7cb-4226-a82d-aaeca79302e9 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:33:13.812458 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-c8e2d638-d7cb-4226-a82d-aaeca79302e9 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] [instance: 83b29c39-45ca-4cb3-ad7d-f7bd47bfe667] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:33:13.819033 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-c8e2d638-d7cb-4226-a82d-aaeca79302e9 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:33:13.819484 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-c8e2d638-d7cb-4226-a82d-aaeca79302e9 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:33:13.820241 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-c8e2d638-d7cb-4226-a82d-aaeca79302e9 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:33:13.820723 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-c8e2d638-d7cb-4226-a82d-aaeca79302e9 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:33:13.920797 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-6a3505ec-e914-4ae4-b125-304957bffaf8 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:33:13.922609 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-6a3505ec-e914-4ae4-b125-304957bffaf8 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] [instance: 22a03003-3677-426e-8fb8-5b58998eef8a] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:33:13.928796 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-6a3505ec-e914-4ae4-b125-304957bffaf8 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:33:13.929249 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-6a3505ec-e914-4ae4-b125-304957bffaf8 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:33:13.930286 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-6a3505ec-e914-4ae4-b125-304957bffaf8 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:33:13.930503 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-6a3505ec-e914-4ae4-b125-304957bffaf8 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:33:13.959341 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-c8e2d638-d7cb-4226-a82d-aaeca79302e9 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af30265de71409d876112350949a2a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f62ef510c8484995a2f31f29104f399f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:33:13.967396 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-c8e2d638-d7cb-4226-a82d-aaeca79302e9 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] 10.222.0.33 "GET /compute/v2.1/servers/83b29c39-45ca-4cb3-ad7d-f7bd47bfe667" status: 200 len: 1757 microversion: 2.1 time: 0.160116 Jul 18 10:33:13.968811 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 307/614] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:33:13 2022] GET /compute/v2.1/servers/83b29c39-45ca-4cb3-ad7d-f7bd47bfe667 => generated 1757 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:33:14.060840 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-6a3505ec-e914-4ae4-b125-304957bffaf8 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9eb8d188e040bca894e038955f2402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c656b71bbd447cba7d11335c928dfda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:33:14.068224 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-6a3505ec-e914-4ae4-b125-304957bffaf8 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] 10.222.0.33 "GET /compute/v2.1/servers/22a03003-3677-426e-8fb8-5b58998eef8a" status: 200 len: 1265 microversion: 2.1 time: 0.152204 Jul 18 10:33:14.068811 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 308/615] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:33:13 2022] GET /compute/v2.1/servers/22a03003-3677-426e-8fb8-5b58998eef8a => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:33:14.985684 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-f76c9774-2e4b-4edc-818c-6a967afc1716 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:33:14.986296 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-f76c9774-2e4b-4edc-818c-6a967afc1716 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] [instance: 83b29c39-45ca-4cb3-ad7d-f7bd47bfe667] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:33:14.992833 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-f76c9774-2e4b-4edc-818c-6a967afc1716 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:33:14.993282 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-f76c9774-2e4b-4edc-818c-6a967afc1716 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:33:14.994042 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-f76c9774-2e4b-4edc-818c-6a967afc1716 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:33:14.994477 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-f76c9774-2e4b-4edc-818c-6a967afc1716 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:33:15.085252 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-80543b45-3f9f-499a-a363-b1c0d4c210fd tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:33:15.085863 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-80543b45-3f9f-499a-a363-b1c0d4c210fd tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] [instance: 22a03003-3677-426e-8fb8-5b58998eef8a] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:33:15.092248 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-80543b45-3f9f-499a-a363-b1c0d4c210fd tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:33:15.093376 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-80543b45-3f9f-499a-a363-b1c0d4c210fd tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:33:15.094145 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-80543b45-3f9f-499a-a363-b1c0d4c210fd tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:33:15.094573 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-80543b45-3f9f-499a-a363-b1c0d4c210fd tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:33:15.143682 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-f76c9774-2e4b-4edc-818c-6a967afc1716 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af30265de71409d876112350949a2a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f62ef510c8484995a2f31f29104f399f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:33:15.151549 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-f76c9774-2e4b-4edc-818c-6a967afc1716 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] 10.222.0.33 "GET /compute/v2.1/servers/83b29c39-45ca-4cb3-ad7d-f7bd47bfe667" status: 200 len: 1757 microversion: 2.1 time: 0.169792 Jul 18 10:33:15.152110 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 308/616] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:33:14 2022] GET /compute/v2.1/servers/83b29c39-45ca-4cb3-ad7d-f7bd47bfe667 => generated 1757 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:33:15.231854 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-80543b45-3f9f-499a-a363-b1c0d4c210fd tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9eb8d188e040bca894e038955f2402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c656b71bbd447cba7d11335c928dfda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:33:15.239369 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-80543b45-3f9f-499a-a363-b1c0d4c210fd tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] 10.222.0.33 "GET /compute/v2.1/servers/22a03003-3677-426e-8fb8-5b58998eef8a" status: 200 len: 1265 microversion: 2.1 time: 0.157928 Jul 18 10:33:15.239857 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 309/617] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:33:15 2022] GET /compute/v2.1/servers/22a03003-3677-426e-8fb8-5b58998eef8a => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:33:16.173293 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-646da529-801c-431b-b0c8-443ad6736c3e tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:33:16.173894 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-646da529-801c-431b-b0c8-443ad6736c3e tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] [instance: 83b29c39-45ca-4cb3-ad7d-f7bd47bfe667] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:33:16.180597 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-646da529-801c-431b-b0c8-443ad6736c3e tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:33:16.181042 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-646da529-801c-431b-b0c8-443ad6736c3e tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:33:16.181804 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-646da529-801c-431b-b0c8-443ad6736c3e tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:33:16.182230 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-646da529-801c-431b-b0c8-443ad6736c3e tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:33:16.255182 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-1e98b882-756d-427e-883d-ec522c36cef3 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:33:16.255924 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-1e98b882-756d-427e-883d-ec522c36cef3 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] [instance: 22a03003-3677-426e-8fb8-5b58998eef8a] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:33:16.262414 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-1e98b882-756d-427e-883d-ec522c36cef3 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:33:16.262862 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-1e98b882-756d-427e-883d-ec522c36cef3 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:33:16.263658 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-1e98b882-756d-427e-883d-ec522c36cef3 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:33:16.264097 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-1e98b882-756d-427e-883d-ec522c36cef3 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:33:16.351752 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-646da529-801c-431b-b0c8-443ad6736c3e tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af30265de71409d876112350949a2a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f62ef510c8484995a2f31f29104f399f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:33:16.359977 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-646da529-801c-431b-b0c8-443ad6736c3e tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] 10.222.0.33 "GET /compute/v2.1/servers/83b29c39-45ca-4cb3-ad7d-f7bd47bfe667" status: 200 len: 1757 microversion: 2.1 time: 0.191042 Jul 18 10:33:16.360422 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 309/618] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:33:16 2022] GET /compute/v2.1/servers/83b29c39-45ca-4cb3-ad7d-f7bd47bfe667 => generated 1757 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:33:16.416196 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-1e98b882-756d-427e-883d-ec522c36cef3 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9eb8d188e040bca894e038955f2402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c656b71bbd447cba7d11335c928dfda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:33:16.423500 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-1e98b882-756d-427e-883d-ec522c36cef3 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] 10.222.0.33 "GET /compute/v2.1/servers/22a03003-3677-426e-8fb8-5b58998eef8a" status: 200 len: 1451 microversion: 2.1 time: 0.172285 Jul 18 10:33:16.424052 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 310/619] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:33:16 2022] GET /compute/v2.1/servers/22a03003-3677-426e-8fb8-5b58998eef8a => generated 1451 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:33:16.439148 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-4ea2bf1a-fcab-46c8-8ea0-911b1420b60a tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:33:16.439747 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-4ea2bf1a-fcab-46c8-8ea0-911b1420b60a tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] [instance: 22a03003-3677-426e-8fb8-5b58998eef8a] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:33:16.445592 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-4ea2bf1a-fcab-46c8-8ea0-911b1420b60a tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:33:16.446030 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-4ea2bf1a-fcab-46c8-8ea0-911b1420b60a tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:33:16.446784 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-4ea2bf1a-fcab-46c8-8ea0-911b1420b60a tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:33:16.447217 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-4ea2bf1a-fcab-46c8-8ea0-911b1420b60a tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:33:16.575240 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-4ea2bf1a-fcab-46c8-8ea0-911b1420b60a tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9eb8d188e040bca894e038955f2402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c656b71bbd447cba7d11335c928dfda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:33:16.583396 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-4ea2bf1a-fcab-46c8-8ea0-911b1420b60a tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] 10.222.0.33 "GET /compute/v2.1/servers/22a03003-3677-426e-8fb8-5b58998eef8a" status: 200 len: 1451 microversion: 2.1 time: 0.148026 Jul 18 10:33:16.583962 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 310/620] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:33:16 2022] GET /compute/v2.1/servers/22a03003-3677-426e-8fb8-5b58998eef8a => generated 1451 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:33:17.376774 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-b2000cf5-6b4c-4f52-8e2c-896a2238a008 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:33:17.377376 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-b2000cf5-6b4c-4f52-8e2c-896a2238a008 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] [instance: 83b29c39-45ca-4cb3-ad7d-f7bd47bfe667] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:33:17.383567 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-b2000cf5-6b4c-4f52-8e2c-896a2238a008 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:33:17.384018 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-b2000cf5-6b4c-4f52-8e2c-896a2238a008 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:33:17.384802 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-b2000cf5-6b4c-4f52-8e2c-896a2238a008 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:33:17.385235 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-b2000cf5-6b4c-4f52-8e2c-896a2238a008 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:33:17.534231 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-b2000cf5-6b4c-4f52-8e2c-896a2238a008 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af30265de71409d876112350949a2a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f62ef510c8484995a2f31f29104f399f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:33:17.542139 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-b2000cf5-6b4c-4f52-8e2c-896a2238a008 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] 10.222.0.33 "GET /compute/v2.1/servers/83b29c39-45ca-4cb3-ad7d-f7bd47bfe667" status: 200 len: 1757 microversion: 2.1 time: 0.169400 Jul 18 10:33:17.542705 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 311/621] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:33:17 2022] GET /compute/v2.1/servers/83b29c39-45ca-4cb3-ad7d-f7bd47bfe667 => generated 1757 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:33:18.342684 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [req-21b8775d-73ff-41a5-b4dc-42f47a65774d req-80693b25-c181-4e27-93f7-c374bb379da4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "22a03003-3677-426e-8fb8-5b58998eef8a", "tag": "de125830-3de3-492c-bc45-25ee6ef36473"}]} {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:33:18.351639 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [req-21b8775d-73ff-41a5-b4dc-42f47a65774d req-80693b25-c181-4e27-93f7-c374bb379da4 service nova] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:33:18.352083 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [req-21b8775d-73ff-41a5-b4dc-42f47a65774d req-80693b25-c181-4e27-93f7-c374bb379da4 service nova] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:33:18.363847 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.compute.server_external_events [req-21b8775d-73ff-41a5-b4dc-42f47a65774d req-80693b25-c181-4e27-93f7-c374bb379da4 service nova] Creating event network-changed:de125830-3de3-492c-bc45-25ee6ef36473 for instance 22a03003-3677-426e-8fb8-5b58998eef8a on hv-cinder-83754 Jul 18 10:33:18.368899 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [req-21b8775d-73ff-41a5-b4dc-42f47a65774d req-80693b25-c181-4e27-93f7-c374bb379da4 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030008 Jul 18 10:33:18.369686 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 311/622] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jul 18 10:33:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 10:33:18.559196 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-48eeb658-0254-4424-85f9-482d36d4e8ee tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:33:18.559784 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-48eeb658-0254-4424-85f9-482d36d4e8ee tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] [instance: 83b29c39-45ca-4cb3-ad7d-f7bd47bfe667] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:33:18.566470 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-48eeb658-0254-4424-85f9-482d36d4e8ee tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:33:18.567203 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-48eeb658-0254-4424-85f9-482d36d4e8ee tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:33:18.567987 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-48eeb658-0254-4424-85f9-482d36d4e8ee tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:33:18.568419 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-48eeb658-0254-4424-85f9-482d36d4e8ee tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:33:18.572948 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG dbcounter [-] [117880] Writing DB stats nova_cell1:SELECT=100 {{(pid=117880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:33:18.869543 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-48eeb658-0254-4424-85f9-482d36d4e8ee tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af30265de71409d876112350949a2a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f62ef510c8484995a2f31f29104f399f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:33:18.878107 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-48eeb658-0254-4424-85f9-482d36d4e8ee tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] 10.222.0.33 "GET /compute/v2.1/servers/83b29c39-45ca-4cb3-ad7d-f7bd47bfe667" status: 200 len: 1757 microversion: 2.1 time: 0.322782 Jul 18 10:33:18.878691 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 312/623] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:33:18 2022] GET /compute/v2.1/servers/83b29c39-45ca-4cb3-ad7d-f7bd47bfe667 => generated 1757 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:33:19.896267 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-f7da84a5-69b3-4dc9-8720-99ee14d449af tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:33:19.896994 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-f7da84a5-69b3-4dc9-8720-99ee14d449af tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] [instance: 83b29c39-45ca-4cb3-ad7d-f7bd47bfe667] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:33:19.899431 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG dbcounter [-] [117879] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3 {{(pid=117879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:33:19.905086 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-f7da84a5-69b3-4dc9-8720-99ee14d449af tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:33:19.905536 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-f7da84a5-69b3-4dc9-8720-99ee14d449af tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:33:19.906811 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-f7da84a5-69b3-4dc9-8720-99ee14d449af tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:33:19.907244 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-f7da84a5-69b3-4dc9-8720-99ee14d449af tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:33:20.055581 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-f7da84a5-69b3-4dc9-8720-99ee14d449af tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af30265de71409d876112350949a2a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f62ef510c8484995a2f31f29104f399f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:33:20.063389 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-f7da84a5-69b3-4dc9-8720-99ee14d449af tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] 10.222.0.33 "GET /compute/v2.1/servers/83b29c39-45ca-4cb3-ad7d-f7bd47bfe667" status: 200 len: 1757 microversion: 2.1 time: 0.171251 Jul 18 10:33:20.063951 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 312/624] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:33:19 2022] GET /compute/v2.1/servers/83b29c39-45ca-4cb3-ad7d-f7bd47bfe667 => generated 1757 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:33:21.080691 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-363e8927-c4a4-4f2a-ba8e-94a783e47c16 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:33:21.081299 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-363e8927-c4a4-4f2a-ba8e-94a783e47c16 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] [instance: 83b29c39-45ca-4cb3-ad7d-f7bd47bfe667] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:33:21.087741 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-363e8927-c4a4-4f2a-ba8e-94a783e47c16 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:33:21.088187 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-363e8927-c4a4-4f2a-ba8e-94a783e47c16 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:33:21.088973 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-363e8927-c4a4-4f2a-ba8e-94a783e47c16 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:33:21.089404 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-363e8927-c4a4-4f2a-ba8e-94a783e47c16 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:33:21.232450 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-363e8927-c4a4-4f2a-ba8e-94a783e47c16 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af30265de71409d876112350949a2a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f62ef510c8484995a2f31f29104f399f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:33:21.241089 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-363e8927-c4a4-4f2a-ba8e-94a783e47c16 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] 10.222.0.33 "GET /compute/v2.1/servers/83b29c39-45ca-4cb3-ad7d-f7bd47bfe667" status: 200 len: 1757 microversion: 2.1 time: 0.164630 Jul 18 10:33:21.241650 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 313/625] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:33:21 2022] GET /compute/v2.1/servers/83b29c39-45ca-4cb3-ad7d-f7bd47bfe667 => generated 1757 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:33:22.258520 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-8a1a6b71-4638-483a-b361-2ed0b5e9bcd1 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:33:22.259116 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-8a1a6b71-4638-483a-b361-2ed0b5e9bcd1 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] [instance: 83b29c39-45ca-4cb3-ad7d-f7bd47bfe667] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:33:22.266209 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-8a1a6b71-4638-483a-b361-2ed0b5e9bcd1 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:33:22.266652 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-8a1a6b71-4638-483a-b361-2ed0b5e9bcd1 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:33:22.267400 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-8a1a6b71-4638-483a-b361-2ed0b5e9bcd1 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:33:22.267830 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-8a1a6b71-4638-483a-b361-2ed0b5e9bcd1 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:33:22.411226 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-8a1a6b71-4638-483a-b361-2ed0b5e9bcd1 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af30265de71409d876112350949a2a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f62ef510c8484995a2f31f29104f399f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:33:22.418966 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-8a1a6b71-4638-483a-b361-2ed0b5e9bcd1 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] 10.222.0.33 "GET /compute/v2.1/servers/83b29c39-45ca-4cb3-ad7d-f7bd47bfe667" status: 200 len: 1757 microversion: 2.1 time: 0.164278 Jul 18 10:33:22.419529 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 313/626] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:33:22 2022] GET /compute/v2.1/servers/83b29c39-45ca-4cb3-ad7d-f7bd47bfe667 => generated 1757 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:33:23.436918 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-da14060f-a63f-4e35-a3e5-c27c33555baf tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:33:23.437956 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-da14060f-a63f-4e35-a3e5-c27c33555baf tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] [instance: 83b29c39-45ca-4cb3-ad7d-f7bd47bfe667] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:33:23.444315 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-da14060f-a63f-4e35-a3e5-c27c33555baf tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:33:23.444793 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-da14060f-a63f-4e35-a3e5-c27c33555baf tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:33:23.445544 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-da14060f-a63f-4e35-a3e5-c27c33555baf tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:33:23.445973 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-da14060f-a63f-4e35-a3e5-c27c33555baf tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:33:23.590836 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-da14060f-a63f-4e35-a3e5-c27c33555baf tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af30265de71409d876112350949a2a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f62ef510c8484995a2f31f29104f399f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:33:23.599116 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-da14060f-a63f-4e35-a3e5-c27c33555baf tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] 10.222.0.33 "GET /compute/v2.1/servers/83b29c39-45ca-4cb3-ad7d-f7bd47bfe667" status: 200 len: 1757 microversion: 2.1 time: 0.166326 Jul 18 10:33:23.599664 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 314/627] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:33:23 2022] GET /compute/v2.1/servers/83b29c39-45ca-4cb3-ad7d-f7bd47bfe667 => generated 1757 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:33:24.615567 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-73d021d2-8c6f-42fd-9b4f-67b07d5a17c5 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:33:24.616170 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-73d021d2-8c6f-42fd-9b4f-67b07d5a17c5 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] [instance: 83b29c39-45ca-4cb3-ad7d-f7bd47bfe667] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:33:24.622687 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-73d021d2-8c6f-42fd-9b4f-67b07d5a17c5 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:33:24.623139 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-73d021d2-8c6f-42fd-9b4f-67b07d5a17c5 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:33:24.623889 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-73d021d2-8c6f-42fd-9b4f-67b07d5a17c5 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:33:24.624319 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-73d021d2-8c6f-42fd-9b4f-67b07d5a17c5 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:33:24.766353 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-73d021d2-8c6f-42fd-9b4f-67b07d5a17c5 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af30265de71409d876112350949a2a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f62ef510c8484995a2f31f29104f399f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:33:24.774360 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-73d021d2-8c6f-42fd-9b4f-67b07d5a17c5 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] 10.222.0.33 "GET /compute/v2.1/servers/83b29c39-45ca-4cb3-ad7d-f7bd47bfe667" status: 200 len: 1757 microversion: 2.1 time: 0.162606 Jul 18 10:33:24.774936 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 314/628] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:33:24 2022] GET /compute/v2.1/servers/83b29c39-45ca-4cb3-ad7d-f7bd47bfe667 => generated 1757 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:33:25.791183 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-f56edf06-5e41-4aa8-bf03-25d788abe9e6 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:33:25.791813 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-f56edf06-5e41-4aa8-bf03-25d788abe9e6 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] [instance: 83b29c39-45ca-4cb3-ad7d-f7bd47bfe667] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:33:25.794287 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG dbcounter [-] [117880] Writing DB stats nova_api:SELECT=70 {{(pid=117880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:33:25.800176 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-f56edf06-5e41-4aa8-bf03-25d788abe9e6 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:33:25.800649 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-f56edf06-5e41-4aa8-bf03-25d788abe9e6 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:33:25.801479 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-f56edf06-5e41-4aa8-bf03-25d788abe9e6 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:33:25.801904 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-f56edf06-5e41-4aa8-bf03-25d788abe9e6 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:33:25.945396 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-f56edf06-5e41-4aa8-bf03-25d788abe9e6 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af30265de71409d876112350949a2a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f62ef510c8484995a2f31f29104f399f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:33:25.953650 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-f56edf06-5e41-4aa8-bf03-25d788abe9e6 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] 10.222.0.33 "GET /compute/v2.1/servers/83b29c39-45ca-4cb3-ad7d-f7bd47bfe667" status: 200 len: 1757 microversion: 2.1 time: 0.165740 Jul 18 10:33:25.954208 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 315/629] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:33:25 2022] GET /compute/v2.1/servers/83b29c39-45ca-4cb3-ad7d-f7bd47bfe667 => generated 1757 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:33:26.971605 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-3f42cb6c-c0d4-410e-b0d3-ec92a0b8f667 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:33:26.972126 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-3f42cb6c-c0d4-410e-b0d3-ec92a0b8f667 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] [instance: 83b29c39-45ca-4cb3-ad7d-f7bd47bfe667] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:33:26.978951 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-3f42cb6c-c0d4-410e-b0d3-ec92a0b8f667 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:33:26.979403 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-3f42cb6c-c0d4-410e-b0d3-ec92a0b8f667 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:33:26.980166 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-3f42cb6c-c0d4-410e-b0d3-ec92a0b8f667 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:33:26.980637 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-3f42cb6c-c0d4-410e-b0d3-ec92a0b8f667 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:33:27.128049 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-3f42cb6c-c0d4-410e-b0d3-ec92a0b8f667 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af30265de71409d876112350949a2a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f62ef510c8484995a2f31f29104f399f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:33:27.135924 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-3f42cb6c-c0d4-410e-b0d3-ec92a0b8f667 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] 10.222.0.33 "GET /compute/v2.1/servers/83b29c39-45ca-4cb3-ad7d-f7bd47bfe667" status: 200 len: 1757 microversion: 2.1 time: 0.168856 Jul 18 10:33:27.136485 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 315/630] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:33:26 2022] GET /compute/v2.1/servers/83b29c39-45ca-4cb3-ad7d-f7bd47bfe667 => generated 1757 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:33:28.154765 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-3bd60664-3664-43d5-97fe-6cc23465dfa0 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:33:28.155370 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-3bd60664-3664-43d5-97fe-6cc23465dfa0 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] [instance: 83b29c39-45ca-4cb3-ad7d-f7bd47bfe667] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:33:28.162391 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-3bd60664-3664-43d5-97fe-6cc23465dfa0 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:33:28.162837 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-3bd60664-3664-43d5-97fe-6cc23465dfa0 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:33:28.163597 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-3bd60664-3664-43d5-97fe-6cc23465dfa0 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:33:28.164030 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-3bd60664-3664-43d5-97fe-6cc23465dfa0 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:33:28.308203 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-3bd60664-3664-43d5-97fe-6cc23465dfa0 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af30265de71409d876112350949a2a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f62ef510c8484995a2f31f29104f399f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:33:28.316402 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-3bd60664-3664-43d5-97fe-6cc23465dfa0 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] 10.222.0.33 "GET /compute/v2.1/servers/83b29c39-45ca-4cb3-ad7d-f7bd47bfe667" status: 200 len: 1757 microversion: 2.1 time: 0.165616 Jul 18 10:33:28.317158 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 316/631] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:33:28 2022] GET /compute/v2.1/servers/83b29c39-45ca-4cb3-ad7d-f7bd47bfe667 => generated 1757 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:33:29.333415 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-5aef956c-4daf-4b79-b328-4423a545f6b2 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:33:29.333956 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-5aef956c-4daf-4b79-b328-4423a545f6b2 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] [instance: 83b29c39-45ca-4cb3-ad7d-f7bd47bfe667] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:33:29.340429 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-5aef956c-4daf-4b79-b328-4423a545f6b2 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:33:29.340915 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-5aef956c-4daf-4b79-b328-4423a545f6b2 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:33:29.341680 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-5aef956c-4daf-4b79-b328-4423a545f6b2 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:33:29.342112 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-5aef956c-4daf-4b79-b328-4423a545f6b2 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:33:29.486049 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-5aef956c-4daf-4b79-b328-4423a545f6b2 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af30265de71409d876112350949a2a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f62ef510c8484995a2f31f29104f399f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:33:29.493989 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-5aef956c-4daf-4b79-b328-4423a545f6b2 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] 10.222.0.33 "GET /compute/v2.1/servers/83b29c39-45ca-4cb3-ad7d-f7bd47bfe667" status: 200 len: 1757 microversion: 2.1 time: 0.164668 Jul 18 10:33:29.494551 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 316/632] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:33:29 2022] GET /compute/v2.1/servers/83b29c39-45ca-4cb3-ad7d-f7bd47bfe667 => generated 1757 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:33:30.511253 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-18e7f21e-2d23-4c4b-b9d4-060accc9a6da tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:33:30.511781 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-18e7f21e-2d23-4c4b-b9d4-060accc9a6da tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] [instance: 83b29c39-45ca-4cb3-ad7d-f7bd47bfe667] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:33:30.519185 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-18e7f21e-2d23-4c4b-b9d4-060accc9a6da tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:33:30.519627 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-18e7f21e-2d23-4c4b-b9d4-060accc9a6da tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:33:30.520378 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-18e7f21e-2d23-4c4b-b9d4-060accc9a6da tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:33:30.520834 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-18e7f21e-2d23-4c4b-b9d4-060accc9a6da tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:33:30.662000 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-18e7f21e-2d23-4c4b-b9d4-060accc9a6da tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af30265de71409d876112350949a2a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f62ef510c8484995a2f31f29104f399f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:33:30.670205 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-18e7f21e-2d23-4c4b-b9d4-060accc9a6da tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] 10.222.0.33 "GET /compute/v2.1/servers/83b29c39-45ca-4cb3-ad7d-f7bd47bfe667" status: 200 len: 1757 microversion: 2.1 time: 0.162843 Jul 18 10:33:30.670943 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 317/633] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:33:30 2022] GET /compute/v2.1/servers/83b29c39-45ca-4cb3-ad7d-f7bd47bfe667 => generated 1757 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:33:31.687605 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-616f26d1-87e6-42d1-9803-37789911838d tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:33:31.688214 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-616f26d1-87e6-42d1-9803-37789911838d tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] [instance: 83b29c39-45ca-4cb3-ad7d-f7bd47bfe667] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:33:31.694843 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-616f26d1-87e6-42d1-9803-37789911838d tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:33:31.695295 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-616f26d1-87e6-42d1-9803-37789911838d tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:33:31.696057 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-616f26d1-87e6-42d1-9803-37789911838d tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:33:31.696493 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-616f26d1-87e6-42d1-9803-37789911838d tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:33:31.840519 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-616f26d1-87e6-42d1-9803-37789911838d tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af30265de71409d876112350949a2a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f62ef510c8484995a2f31f29104f399f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:33:31.848264 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-616f26d1-87e6-42d1-9803-37789911838d tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] 10.222.0.33 "GET /compute/v2.1/servers/83b29c39-45ca-4cb3-ad7d-f7bd47bfe667" status: 200 len: 1757 microversion: 2.1 time: 0.164979 Jul 18 10:33:31.848860 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 317/634] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:33:31 2022] GET /compute/v2.1/servers/83b29c39-45ca-4cb3-ad7d-f7bd47bfe667 => generated 1757 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:33:32.865615 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-7a212927-b05c-4756-a274-5a92d5dcde7b tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:33:32.866314 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-7a212927-b05c-4756-a274-5a92d5dcde7b tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] [instance: 83b29c39-45ca-4cb3-ad7d-f7bd47bfe667] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:33:32.872961 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-7a212927-b05c-4756-a274-5a92d5dcde7b tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:33:32.873402 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-7a212927-b05c-4756-a274-5a92d5dcde7b tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:33:32.874150 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-7a212927-b05c-4756-a274-5a92d5dcde7b tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:33:32.874609 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-7a212927-b05c-4756-a274-5a92d5dcde7b tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:33:33.014508 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-7a212927-b05c-4756-a274-5a92d5dcde7b tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af30265de71409d876112350949a2a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f62ef510c8484995a2f31f29104f399f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:33:33.022927 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-7a212927-b05c-4756-a274-5a92d5dcde7b tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] 10.222.0.33 "GET /compute/v2.1/servers/83b29c39-45ca-4cb3-ad7d-f7bd47bfe667" status: 200 len: 1757 microversion: 2.1 time: 0.161116 Jul 18 10:33:33.023488 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 318/635] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:33:32 2022] GET /compute/v2.1/servers/83b29c39-45ca-4cb3-ad7d-f7bd47bfe667 => generated 1757 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:33:34.040697 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-fe4a76ea-8b64-4062-ad3d-05ec40c1ee97 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:33:34.041305 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-fe4a76ea-8b64-4062-ad3d-05ec40c1ee97 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] [instance: 83b29c39-45ca-4cb3-ad7d-f7bd47bfe667] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:33:34.047724 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-fe4a76ea-8b64-4062-ad3d-05ec40c1ee97 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:33:34.048181 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-fe4a76ea-8b64-4062-ad3d-05ec40c1ee97 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:33:34.049099 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-fe4a76ea-8b64-4062-ad3d-05ec40c1ee97 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:33:34.049510 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-fe4a76ea-8b64-4062-ad3d-05ec40c1ee97 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:33:34.193357 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-fe4a76ea-8b64-4062-ad3d-05ec40c1ee97 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af30265de71409d876112350949a2a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f62ef510c8484995a2f31f29104f399f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:33:34.201821 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-fe4a76ea-8b64-4062-ad3d-05ec40c1ee97 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] 10.222.0.33 "GET /compute/v2.1/servers/83b29c39-45ca-4cb3-ad7d-f7bd47bfe667" status: 200 len: 1757 microversion: 2.1 time: 0.165030 Jul 18 10:33:34.202384 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 318/636] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:33:34 2022] GET /compute/v2.1/servers/83b29c39-45ca-4cb3-ad7d-f7bd47bfe667 => generated 1757 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:33:35.221190 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-a4c9eb33-3670-4288-834b-d29bd1bc33c4 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:33:35.221800 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-a4c9eb33-3670-4288-834b-d29bd1bc33c4 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] [instance: 83b29c39-45ca-4cb3-ad7d-f7bd47bfe667] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:33:35.228395 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-a4c9eb33-3670-4288-834b-d29bd1bc33c4 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:33:35.228867 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-a4c9eb33-3670-4288-834b-d29bd1bc33c4 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:33:35.229616 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-a4c9eb33-3670-4288-834b-d29bd1bc33c4 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:33:35.230043 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-a4c9eb33-3670-4288-834b-d29bd1bc33c4 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:33:35.369635 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-a4c9eb33-3670-4288-834b-d29bd1bc33c4 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af30265de71409d876112350949a2a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f62ef510c8484995a2f31f29104f399f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:33:35.377897 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-a4c9eb33-3670-4288-834b-d29bd1bc33c4 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] 10.222.0.33 "GET /compute/v2.1/servers/83b29c39-45ca-4cb3-ad7d-f7bd47bfe667" status: 200 len: 1760 microversion: 2.1 time: 0.161557 Jul 18 10:33:35.378448 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 319/637] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:33:35 2022] GET /compute/v2.1/servers/83b29c39-45ca-4cb3-ad7d-f7bd47bfe667 => generated 1760 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:33:43.019774 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-9b2ba017-3d8d-4545-98ad-a3bc4c05ce13 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:33:43.020736 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-9b2ba017-3d8d-4545-98ad-a3bc4c05ce13 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] [instance: dcb1b50b-9e62-4ff3-9875-3d4635597b45] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:33:43.027192 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-9b2ba017-3d8d-4545-98ad-a3bc4c05ce13 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:33:43.027639 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-9b2ba017-3d8d-4545-98ad-a3bc4c05ce13 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:33:43.028399 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-9b2ba017-3d8d-4545-98ad-a3bc4c05ce13 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:33:43.028868 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-9b2ba017-3d8d-4545-98ad-a3bc4c05ce13 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:33:43.056003 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-9b2ba017-3d8d-4545-98ad-a3bc4c05ce13 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] 10.222.0.33 "GET /compute/v2.1/servers/dcb1b50b-9e62-4ff3-9875-3d4635597b45/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.040686 Jul 18 10:33:43.056558 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 319/638] 10.222.0.33 () {58 vars in 1301 bytes} [Mon Jul 18 10:33:43 2022] GET /compute/v2.1/servers/dcb1b50b-9e62-4ff3-9875-3d4635597b45/os-volume_attachments => generated 25 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 10:33:43.113805 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-a349ad5f-dad0-47de-855a-2699aea1656b tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:33:43.114368 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-a349ad5f-dad0-47de-855a-2699aea1656b tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] [instance: dcb1b50b-9e62-4ff3-9875-3d4635597b45] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:33:43.120994 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-a349ad5f-dad0-47de-855a-2699aea1656b tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:33:43.121441 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-a349ad5f-dad0-47de-855a-2699aea1656b tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:33:43.122199 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-a349ad5f-dad0-47de-855a-2699aea1656b tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:33:43.122633 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-a349ad5f-dad0-47de-855a-2699aea1656b tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:33:43.149244 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-a349ad5f-dad0-47de-855a-2699aea1656b tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] [instance: dcb1b50b-9e62-4ff3-9875-3d4635597b45] Going to try to terminate instance {{(pid=117880) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 10:33:43.223611 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-a349ad5f-dad0-47de-855a-2699aea1656b tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] 10.222.0.33 "DELETE /compute/v2.1/servers/dcb1b50b-9e62-4ff3-9875-3d4635597b45" status: 204 len: 0 microversion: 2.1 time: 0.113302 Jul 18 10:33:43.224232 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 320/639] 10.222.0.33 () {58 vars in 1238 bytes} [Mon Jul 18 10:33:43 2022] DELETE /compute/v2.1/servers/dcb1b50b-9e62-4ff3-9875-3d4635597b45 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 10:33:43.232544 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-6c902dd1-7208-4ff5-a3a2-da8d5ec7794a tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:33:43.233157 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-6c902dd1-7208-4ff5-a3a2-da8d5ec7794a tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] [instance: dcb1b50b-9e62-4ff3-9875-3d4635597b45] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:33:43.239028 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-6c902dd1-7208-4ff5-a3a2-da8d5ec7794a tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:33:43.239486 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-6c902dd1-7208-4ff5-a3a2-da8d5ec7794a tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:33:43.240248 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-6c902dd1-7208-4ff5-a3a2-da8d5ec7794a tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:33:43.240729 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-6c902dd1-7208-4ff5-a3a2-da8d5ec7794a tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:33:43.371265 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-6c902dd1-7208-4ff5-a3a2-da8d5ec7794a tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '986f90dfbad14324b3fffbd790d60a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e487deb7ff45bdbf2cc002d42d12a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:33:43.379299 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-6c902dd1-7208-4ff5-a3a2-da8d5ec7794a tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] 10.222.0.33 "GET /compute/v2.1/servers/dcb1b50b-9e62-4ff3-9875-3d4635597b45" status: 200 len: 1671 microversion: 2.1 time: 0.150573 Jul 18 10:33:43.379861 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 320/640] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:33:43 2022] GET /compute/v2.1/servers/dcb1b50b-9e62-4ff3-9875-3d4635597b45 => generated 1671 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:33:44.396430 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-f089e60f-26aa-4220-9637-ad3a86b26bd7 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:33:44.397150 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-f089e60f-26aa-4220-9637-ad3a86b26bd7 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] [instance: dcb1b50b-9e62-4ff3-9875-3d4635597b45] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:33:44.403520 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-f089e60f-26aa-4220-9637-ad3a86b26bd7 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:33:44.403968 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-f089e60f-26aa-4220-9637-ad3a86b26bd7 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:33:44.404762 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-f089e60f-26aa-4220-9637-ad3a86b26bd7 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:33:44.405196 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-f089e60f-26aa-4220-9637-ad3a86b26bd7 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:33:44.534761 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-f089e60f-26aa-4220-9637-ad3a86b26bd7 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '986f90dfbad14324b3fffbd790d60a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e487deb7ff45bdbf2cc002d42d12a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:33:44.542381 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-f089e60f-26aa-4220-9637-ad3a86b26bd7 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] 10.222.0.33 "GET /compute/v2.1/servers/dcb1b50b-9e62-4ff3-9875-3d4635597b45" status: 200 len: 1671 microversion: 2.1 time: 0.150113 Jul 18 10:33:44.542937 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 321/641] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:33:44 2022] GET /compute/v2.1/servers/dcb1b50b-9e62-4ff3-9875-3d4635597b45 => generated 1671 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:33:45.519565 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-093eadfb-52e2-4f98-9a0d-7ccbead9c4e2 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:33:45.520045 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-093eadfb-52e2-4f98-9a0d-7ccbead9c4e2 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] [instance: a3dbac58-662d-4720-8bcf-2300f9a9a5d1] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:33:45.526399 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-093eadfb-52e2-4f98-9a0d-7ccbead9c4e2 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:33:45.526846 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-093eadfb-52e2-4f98-9a0d-7ccbead9c4e2 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:33:45.527595 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-093eadfb-52e2-4f98-9a0d-7ccbead9c4e2 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:33:45.528024 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-093eadfb-52e2-4f98-9a0d-7ccbead9c4e2 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:33:45.532343 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG dbcounter [-] [117879] Writing DB stats nova_cell1:SELECT=81 {{(pid=117879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:33:45.559545 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-66066202-eef0-49cc-89c2-118ccb04deeb tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:33:45.560048 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-66066202-eef0-49cc-89c2-118ccb04deeb tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] [instance: dcb1b50b-9e62-4ff3-9875-3d4635597b45] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:33:45.567925 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-66066202-eef0-49cc-89c2-118ccb04deeb tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:33:45.568716 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-66066202-eef0-49cc-89c2-118ccb04deeb tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:33:45.569737 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-66066202-eef0-49cc-89c2-118ccb04deeb tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:33:45.570204 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-66066202-eef0-49cc-89c2-118ccb04deeb tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:33:45.612358 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.objects.instance [None req-093eadfb-52e2-4f98-9a0d-7ccbead9c4e2 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lazy-loading 'services' on Instance uuid a3dbac58-662d-4720-8bcf-2300f9a9a5d1 {{(pid=117879) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 10:33:45.689874 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-093eadfb-52e2-4f98-9a0d-7ccbead9c4e2 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] 10.222.0.33 "DELETE /compute/v2.1/servers/a3dbac58-662d-4720-8bcf-2300f9a9a5d1/os-volume_attachments/763d6f81-f7c8-4a96-be85-5afcc42a6739" status: 202 len: 0 microversion: 2.1 time: 0.174404 Jul 18 10:33:45.690465 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 321/642] 10.222.0.33 () {58 vars in 1415 bytes} [Mon Jul 18 10:33:45 2022] DELETE /compute/v2.1/servers/a3dbac58-662d-4720-8bcf-2300f9a9a5d1/os-volume_attachments/763d6f81-f7c8-4a96-be85-5afcc42a6739 => generated 0 bytes in 176 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 10:33:45.699134 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-a9f7ddca-5968-4d22-88e3-ad3ba9c47d98 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:33:45.700282 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-a9f7ddca-5968-4d22-88e3-ad3ba9c47d98 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] [instance: a3dbac58-662d-4720-8bcf-2300f9a9a5d1] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:33:45.707743 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-a9f7ddca-5968-4d22-88e3-ad3ba9c47d98 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:33:45.708187 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-a9f7ddca-5968-4d22-88e3-ad3ba9c47d98 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:33:45.709035 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-a9f7ddca-5968-4d22-88e3-ad3ba9c47d98 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:33:45.710185 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-a9f7ddca-5968-4d22-88e3-ad3ba9c47d98 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:33:45.745662 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-a9f7ddca-5968-4d22-88e3-ad3ba9c47d98 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] 10.222.0.33 "GET /compute/v2.1/servers/a3dbac58-662d-4720-8bcf-2300f9a9a5d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050109 Jul 18 10:33:45.745820 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 322/643] 10.222.0.33 () {58 vars in 1301 bytes} [Mon Jul 18 10:33:45 2022] GET /compute/v2.1/servers/a3dbac58-662d-4720-8bcf-2300f9a9a5d1/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 10:33:45.823891 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-66066202-eef0-49cc-89c2-118ccb04deeb tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '986f90dfbad14324b3fffbd790d60a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e487deb7ff45bdbf2cc002d42d12a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:33:45.831956 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-66066202-eef0-49cc-89c2-118ccb04deeb tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] 10.222.0.33 "GET /compute/v2.1/servers/dcb1b50b-9e62-4ff3-9875-3d4635597b45" status: 200 len: 1671 microversion: 2.1 time: 0.276654 Jul 18 10:33:45.832676 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 322/644] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:33:45 2022] GET /compute/v2.1/servers/dcb1b50b-9e62-4ff3-9875-3d4635597b45 => generated 1671 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:33:46.459831 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [req-c72a5209-4ffd-4619-af16-1f416459251a req-7144f0eb-3855-4983-ab61-7e8b72550d0a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dcb1b50b-9e62-4ff3-9875-3d4635597b45", "name": "network-vif-deleted", "tag": "2be9cb89-71c6-44bf-b559-2446d61bca60"}]} {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:33:46.468027 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [req-c72a5209-4ffd-4619-af16-1f416459251a req-7144f0eb-3855-4983-ab61-7e8b72550d0a service nova] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:33:46.468480 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [req-c72a5209-4ffd-4619-af16-1f416459251a req-7144f0eb-3855-4983-ab61-7e8b72550d0a service nova] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:33:46.480061 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.compute.server_external_events [req-c72a5209-4ffd-4619-af16-1f416459251a req-7144f0eb-3855-4983-ab61-7e8b72550d0a service nova] Creating event network-vif-deleted:2be9cb89-71c6-44bf-b559-2446d61bca60 for instance dcb1b50b-9e62-4ff3-9875-3d4635597b45 on hv-cinder-83754 Jul 18 10:33:46.486208 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [req-c72a5209-4ffd-4619-af16-1f416459251a req-7144f0eb-3855-4983-ab61-7e8b72550d0a service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029413 Jul 18 10:33:46.503534 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 323/645] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jul 18 10:33:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:33:46.757956 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-711b1fc4-67d1-46d1-bb9c-443f7bb0046d tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:33:46.759035 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-711b1fc4-67d1-46d1-bb9c-443f7bb0046d tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] [instance: a3dbac58-662d-4720-8bcf-2300f9a9a5d1] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:33:46.765541 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-711b1fc4-67d1-46d1-bb9c-443f7bb0046d tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:33:46.766074 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-711b1fc4-67d1-46d1-bb9c-443f7bb0046d tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:33:46.767578 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-711b1fc4-67d1-46d1-bb9c-443f7bb0046d tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:33:46.768006 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-711b1fc4-67d1-46d1-bb9c-443f7bb0046d tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:33:46.796959 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-711b1fc4-67d1-46d1-bb9c-443f7bb0046d tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] 10.222.0.33 "GET /compute/v2.1/servers/a3dbac58-662d-4720-8bcf-2300f9a9a5d1/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042912 Jul 18 10:33:46.797463 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 323/646] 10.222.0.33 () {58 vars in 1301 bytes} [Mon Jul 18 10:33:46 2022] GET /compute/v2.1/servers/a3dbac58-662d-4720-8bcf-2300f9a9a5d1/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 10:33:46.849926 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-14503e45-d729-4014-98ff-8984dc14f67d tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:33:46.850868 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-14503e45-d729-4014-98ff-8984dc14f67d tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] [instance: dcb1b50b-9e62-4ff3-9875-3d4635597b45] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:33:46.859529 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-14503e45-d729-4014-98ff-8984dc14f67d tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:33:46.859985 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-14503e45-d729-4014-98ff-8984dc14f67d tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:33:46.861983 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-14503e45-d729-4014-98ff-8984dc14f67d tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:33:46.865303 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-14503e45-d729-4014-98ff-8984dc14f67d tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:33:46.873087 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-dbc15a4e-f799-48e4-8089-2bb76d75b048 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:33:46.873572 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-dbc15a4e-f799-48e4-8089-2bb76d75b048 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] [instance: a3dbac58-662d-4720-8bcf-2300f9a9a5d1] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:33:46.884575 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-dbc15a4e-f799-48e4-8089-2bb76d75b048 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:33:46.885034 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-dbc15a4e-f799-48e4-8089-2bb76d75b048 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:33:46.885799 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-dbc15a4e-f799-48e4-8089-2bb76d75b048 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:33:46.886376 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-dbc15a4e-f799-48e4-8089-2bb76d75b048 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:33:46.914118 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-dbc15a4e-f799-48e4-8089-2bb76d75b048 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] [instance: a3dbac58-662d-4720-8bcf-2300f9a9a5d1] Going to try to terminate instance {{(pid=117880) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 10:33:46.916963 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-14503e45-d729-4014-98ff-8984dc14f67d tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:33:46.917701 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-14503e45-d729-4014-98ff-8984dc14f67d tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:33:46.918341 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.objects.instance [None req-14503e45-d729-4014-98ff-8984dc14f67d tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lazy-loading 'fault' on Instance uuid dcb1b50b-9e62-4ff3-9875-3d4635597b45 {{(pid=117879) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 10:33:46.967870 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-14503e45-d729-4014-98ff-8984dc14f67d tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '986f90dfbad14324b3fffbd790d60a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e487deb7ff45bdbf2cc002d42d12a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:33:46.976981 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-14503e45-d729-4014-98ff-8984dc14f67d tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] 10.222.0.33 "GET /compute/v2.1/servers/dcb1b50b-9e62-4ff3-9875-3d4635597b45" status: 200 len: 1326 microversion: 2.1 time: 0.131468 Jul 18 10:33:46.981361 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 324/647] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:33:46 2022] GET /compute/v2.1/servers/dcb1b50b-9e62-4ff3-9875-3d4635597b45 => generated 1326 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:33:47.021289 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-dbc15a4e-f799-48e4-8089-2bb76d75b048 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] 10.222.0.33 "DELETE /compute/v2.1/servers/a3dbac58-662d-4720-8bcf-2300f9a9a5d1" status: 204 len: 0 microversion: 2.1 time: 0.150681 Jul 18 10:33:47.024798 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 324/648] 10.222.0.33 () {58 vars in 1238 bytes} [Mon Jul 18 10:33:46 2022] DELETE /compute/v2.1/servers/a3dbac58-662d-4720-8bcf-2300f9a9a5d1 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 10:33:47.030829 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-258750f4-89e3-4db5-a2e0-48d5cb2f1aee tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:33:47.031849 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-258750f4-89e3-4db5-a2e0-48d5cb2f1aee tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] [instance: a3dbac58-662d-4720-8bcf-2300f9a9a5d1] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:33:47.038707 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-258750f4-89e3-4db5-a2e0-48d5cb2f1aee tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:33:47.039524 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-258750f4-89e3-4db5-a2e0-48d5cb2f1aee tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:33:47.040626 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-258750f4-89e3-4db5-a2e0-48d5cb2f1aee tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:33:47.041355 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-258750f4-89e3-4db5-a2e0-48d5cb2f1aee tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:33:47.188449 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-258750f4-89e3-4db5-a2e0-48d5cb2f1aee tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a431c9708f4694bc0d514133e76088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a1921237622439bab89676e11477c13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:33:47.197028 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-258750f4-89e3-4db5-a2e0-48d5cb2f1aee tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] 10.222.0.33 "GET /compute/v2.1/servers/a3dbac58-662d-4720-8bcf-2300f9a9a5d1" status: 200 len: 1689 microversion: 2.1 time: 0.170188 Jul 18 10:33:47.197617 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 325/649] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:33:47 2022] GET /compute/v2.1/servers/a3dbac58-662d-4720-8bcf-2300f9a9a5d1 => generated 1689 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:33:47.998616 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-565742f2-0791-439a-b146-4543c79993e1 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:33:47.999312 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-565742f2-0791-439a-b146-4543c79993e1 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] [instance: dcb1b50b-9e62-4ff3-9875-3d4635597b45] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:33:48.005778 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-565742f2-0791-439a-b146-4543c79993e1 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:33:48.006231 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-565742f2-0791-439a-b146-4543c79993e1 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:33:48.007105 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-565742f2-0791-439a-b146-4543c79993e1 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:33:48.007536 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-565742f2-0791-439a-b146-4543c79993e1 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:33:48.021318 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.wsgi [None req-565742f2-0791-439a-b146-4543c79993e1 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] HTTP exception thrown: Instance dcb1b50b-9e62-4ff3-9875-3d4635597b45 could not be found. Jul 18 10:33:48.022892 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-565742f2-0791-439a-b146-4543c79993e1 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Request method failure captured: Jul 18 10:33:48.022892 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: request: GET /compute/v2.1/servers/dcb1b50b-9e62-4ff3-9875-3d4635597b45 HTTP/1.1 Jul 18 10:33:48.022892 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: Accept: application/json Jul 18 10:33:48.022892 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: Accept-Encoding: identity Jul 18 10:33:48.022892 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: Connection: close Jul 18 10:33:48.022892 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: Content-Length: 0 Jul 18 10:33:48.022892 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: Content-Type: application/json Jul 18 10:33:48.022892 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: Host: 10.222.0.33 Jul 18 10:33:48.022892 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: Openstack-System-Scope: None Jul 18 10:33:48.022892 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: User-Agent: python-urllib3/1.26.9 Jul 18 10:33:48.022892 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Auth-Token: gAAAAABi1TXyRuO93YpXTZGzpMcrXvlaMSRFZzr-AHOj2FRT2T5ihWk1lnTRwNGg9PrJbZQjx8rFUCx5FHM_0tuFNIv3bWjwRyt64fUTE1eFuCeWcTmRM14gEGuSdmP8w3Abds2w_lZwqjtKT13oQUVwIT92owvlu3szREV5s5g3P_QW6cRnhQU Jul 18 10:33:48.022892 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Domain-Id: None Jul 18 10:33:48.022892 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Domain-Name: None Jul 18 10:33:48.022892 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Identity-Status: Confirmed Jul 18 10:33:48.022892 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Is-Admin-Project: True Jul 18 10:33:48.022892 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Project-Domain-Id: default Jul 18 10:33:48.022892 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Project-Domain-Name: Default Jul 18 10:33:48.022892 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Project-Id: e6e487deb7ff45bdbf2cc002d42d12a5 Jul 18 10:33:48.022892 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Project-Name: tempest-AttachVolumeTestJSON-1614237976 Jul 18 10:33:48.022892 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Role: member,reader Jul 18 10:33:48.022892 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Roles: member,reader Jul 18 10:33:48.024481 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e6e487deb7ff45bdbf2cc002d42d12a5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e6e487deb7ff45bdbf2cc002d42d12a5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/e6e487deb7ff45bdbf2cc002d42d12a5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_e6e487deb7ff45bdbf2cc002d42d12a5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jul 18 10:33:48.024481 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Tenant: tempest-AttachVolumeTestJSON-1614237976 Jul 18 10:33:48.024481 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Tenant-Id: e6e487deb7ff45bdbf2cc002d42d12a5 Jul 18 10:33:48.024481 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1614237976 Jul 18 10:33:48.024481 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-User: tempest-AttachVolumeTestJSON-1614237976-project Jul 18 10:33:48.024481 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-User-Domain-Id: default Jul 18 10:33:48.024481 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-User-Domain-Name: Default Jul 18 10:33:48.024481 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-User-Id: 986f90dfbad14324b3fffbd790d60a37 Jul 18 10:33:48.024481 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-User-Name: tempest-AttachVolumeTestJSON-1614237976-project Jul 18 10:33:48.024481 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: method: > Jul 18 10:33:48.024481 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: exception: Instance dcb1b50b-9e62-4ff3-9875-3d4635597b45 could not be found. Jul 18 10:33:48.024481 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: action_args: {'id': 'dcb1b50b-9e62-4ff3-9875-3d4635597b45'} Jul 18 10:33:48.025344 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 10:33:48.025344 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:33:48.025344 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 10:33:48.025344 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 10:33:48.025344 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 10:33:48.025344 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 10:33:48.025344 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 10:33:48.025344 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 10:33:48.025344 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 10:33:48.025344 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 10:33:48.025344 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dcb1b50b-9e62-4ff3-9875-3d4635597b45 could not be found. Jul 18 10:33:48.025344 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi Jul 18 10:33:48.025344 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:33:48.025344 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi Jul 18 10:33:48.025344 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:33:48.025344 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:33:48.025344 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:33:48.025344 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 10:33:48.025344 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 10:33:48.025344 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 10:33:48.026590 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 10:33:48.026590 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 10:33:48.026590 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 10:33:48.026590 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 10:33:48.026590 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 10:33:48.026590 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 10:33:48.026590 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 10:33:48.026590 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dcb1b50b-9e62-4ff3-9875-3d4635597b45 could not be found. Jul 18 10:33:48.026590 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi Jul 18 10:33:48.026590 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:33:48.026590 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi Jul 18 10:33:48.026590 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:33:48.026590 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:33:48.026590 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:33:48.026590 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 10:33:48.026590 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 10:33:48.026590 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dcb1b50b-9e62-4ff3-9875-3d4635597b45 could not be found. Jul 18 10:33:48.026590 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi Jul 18 10:33:48.027703 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-565742f2-0791-439a-b146-4543c79993e1 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Returning 404 to user: Instance dcb1b50b-9e62-4ff3-9875-3d4635597b45 could not be found. {{(pid=117880) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 10:33:48.027703 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-565742f2-0791-439a-b146-4543c79993e1 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] 10.222.0.33 "GET /compute/v2.1/servers/dcb1b50b-9e62-4ff3-9875-3d4635597b45" status: 404 len: 111 microversion: 2.1 time: 0.029901 Jul 18 10:33:48.027703 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 325/650] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:33:47 2022] GET /compute/v2.1/servers/dcb1b50b-9e62-4ff3-9875-3d4635597b45 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 10:33:48.033564 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-b62127c7-a4dd-427b-a68c-5ebccc48164b tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Calling method '.version_select at 0x7f9f4a0581f0>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:33:48.051938 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-b62127c7-a4dd-427b-a68c-5ebccc48164b tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-948735427" status: 202 len: 0 microversion: 2.1 time: 0.022769 Jul 18 10:33:48.052493 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 326/651] 10.222.0.33 () {58 vars in 1217 bytes} [Mon Jul 18 10:33:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-948735427 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 10:33:48.214485 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-1d35bbb4-a30c-4581-ae02-98cbc3ea4e88 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:33:48.215075 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-1d35bbb4-a30c-4581-ae02-98cbc3ea4e88 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] [instance: a3dbac58-662d-4720-8bcf-2300f9a9a5d1] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:33:48.222141 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-1d35bbb4-a30c-4581-ae02-98cbc3ea4e88 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:33:48.222914 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-1d35bbb4-a30c-4581-ae02-98cbc3ea4e88 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:33:48.223769 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-1d35bbb4-a30c-4581-ae02-98cbc3ea4e88 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:33:48.224451 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-1d35bbb4-a30c-4581-ae02-98cbc3ea4e88 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:33:48.230396 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG dbcounter [-] [117880] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:33:48.464442 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-1d35bbb4-a30c-4581-ae02-98cbc3ea4e88 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a431c9708f4694bc0d514133e76088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a1921237622439bab89676e11477c13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:33:48.472049 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-1d35bbb4-a30c-4581-ae02-98cbc3ea4e88 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] 10.222.0.33 "GET /compute/v2.1/servers/a3dbac58-662d-4720-8bcf-2300f9a9a5d1" status: 200 len: 1689 microversion: 2.1 time: 0.261385 Jul 18 10:33:48.472648 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 326/652] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:33:48 2022] GET /compute/v2.1/servers/a3dbac58-662d-4720-8bcf-2300f9a9a5d1 => generated 1689 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:33:48.738770 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-7b5491e3-fcea-4729-a5fa-5d12296351fd tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Action: 'create', calling method: .version_select at 0x7f9f4a03c3a0>, body: {"keypair": {"name": "tempest-keypair-27111566", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLGPVxFUvBgMISqbt35AB552wssRv5oK5BNL8/hxXFjj6Uz7j5eq6nMCsIqQdVpTKTm5NxcMkAO5COF7HeM416v/drYwHrwM4hyB+mxhILsAgY0dqa/06QvHrKoaBivRmw=="}} {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:33:48.754527 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.quota [None req-7b5491e3-fcea-4729-a5fa-5d12296351fd tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Getting quotas for project e6e487deb7ff45bdbf2cc002d42d12a5. Resources: {'key_pairs'} {{(pid=117879) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 10:33:48.758252 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.quota [None req-7b5491e3-fcea-4729-a5fa-5d12296351fd tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Getting quotas for user 986f90dfbad14324b3fffbd790d60a37 and project e6e487deb7ff45bdbf2cc002d42d12a5. Resources: {'key_pairs'} {{(pid=117879) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 10:33:48.779261 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-7b5491e3-fcea-4729-a5fa-5d12296351fd tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.044839 Jul 18 10:33:48.779851 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 327/653] 10.222.0.33 () {60 vars in 1158 bytes} [Mon Jul 18 10:33:48 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:33:49.489388 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-08a0e35d-9739-4092-a23a-f415e87dc32a tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:33:49.490028 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-08a0e35d-9739-4092-a23a-f415e87dc32a tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] [instance: a3dbac58-662d-4720-8bcf-2300f9a9a5d1] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:33:49.496479 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-08a0e35d-9739-4092-a23a-f415e87dc32a tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:33:49.496976 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-08a0e35d-9739-4092-a23a-f415e87dc32a tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:33:49.497731 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-08a0e35d-9739-4092-a23a-f415e87dc32a tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:33:49.498316 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-08a0e35d-9739-4092-a23a-f415e87dc32a tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:33:49.636407 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-08a0e35d-9739-4092-a23a-f415e87dc32a tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a431c9708f4694bc0d514133e76088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a1921237622439bab89676e11477c13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:33:49.644673 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-08a0e35d-9739-4092-a23a-f415e87dc32a tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] 10.222.0.33 "GET /compute/v2.1/servers/a3dbac58-662d-4720-8bcf-2300f9a9a5d1" status: 200 len: 1689 microversion: 2.1 time: 0.159214 Jul 18 10:33:49.645166 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 327/654] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:33:49 2022] GET /compute/v2.1/servers/a3dbac58-662d-4720-8bcf-2300f9a9a5d1 => generated 1689 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:33:50.069230 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-88ff6f92-b0c6-4496-bc23-9226aa1d18cb tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-648450713", "imageRef": "2cb02169-9999-411b-8c74-f88c068960fc", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4fd50c95-7888-4b58-b176-0e3d534d461f"}], "security_groups": [{"name": "tempest-securitygroup--1911376199"}], "key_name": "tempest-keypair-27111566", "user_data": "}} {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:33:50.075774 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG dbcounter [-] [117879] Writing DB stats nova_api:SELECT=44,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=117879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:33:50.170539 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.network.neutron [None req-88ff6f92-b0c6-4496-bc23-9226aa1d18cb tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] validate_networks() for [('4fd50c95-7888-4b58-b176-0e3d534d461f', None, None, None, None, None)] {{(pid=117879) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 10:33:50.529488 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.virt.hardware [None req-88ff6f92-b0c6-4496-bc23-9226aa1d18cb tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Flavor limits 0:0:0 {{(pid=117879) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 10:33:50.529911 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.virt.hardware [None req-88ff6f92-b0c6-4496-bc23-9226aa1d18cb tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Image limits 0:0:0 {{(pid=117879) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 10:33:50.530382 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.virt.hardware [None req-88ff6f92-b0c6-4496-bc23-9226aa1d18cb tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Flavor pref 0:0:0 {{(pid=117879) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 10:33:50.530788 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.virt.hardware [None req-88ff6f92-b0c6-4496-bc23-9226aa1d18cb tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Image pref 0:0:0 {{(pid=117879) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 10:33:50.531193 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.virt.hardware [None req-88ff6f92-b0c6-4496-bc23-9226aa1d18cb tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117879) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 10:33:50.541310 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-88ff6f92-b0c6-4496-bc23-9226aa1d18cb tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:33:50.541992 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-88ff6f92-b0c6-4496-bc23-9226aa1d18cb tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:33:50.543010 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-88ff6f92-b0c6-4496-bc23-9226aa1d18cb tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:33:50.543587 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-88ff6f92-b0c6-4496-bc23-9226aa1d18cb tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:33:50.565114 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.quota [None req-88ff6f92-b0c6-4496-bc23-9226aa1d18cb tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Getting quotas for project e6e487deb7ff45bdbf2cc002d42d12a5. Resources: {'ram', 'cores', 'instances'} {{(pid=117879) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 10:33:50.569451 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.quota [None req-88ff6f92-b0c6-4496-bc23-9226aa1d18cb tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Getting quotas for user 986f90dfbad14324b3fffbd790d60a37 and project e6e487deb7ff45bdbf2cc002d42d12a5. Resources: {'ram', 'cores', 'instances'} {{(pid=117879) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 10:33:50.583386 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-88ff6f92-b0c6-4496-bc23-9226aa1d18cb tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Going to run 1 instances... {{(pid=117879) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 10:33:50.585656 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-88ff6f92-b0c6-4496-bc23-9226aa1d18cb tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] [instance: 9cdd676f-7b24-4c7e-849c-97e196465a3c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2cb02169-9999-411b-8c74-f88c068960fc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117879) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 10:33:50.632529 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-88ff6f92-b0c6-4496-bc23-9226aa1d18cb tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.568110 Jul 18 10:33:50.633509 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 328/655] 10.222.0.33 () {60 vars in 1146 bytes} [Mon Jul 18 10:33:50 2022] POST /compute/v2.1/servers => generated 402 bytes in 570 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 10:33:50.643626 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-e1488338-0d3d-4c45-b988-647380acbdaa tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:33:50.644227 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-e1488338-0d3d-4c45-b988-647380acbdaa tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] [instance: 9cdd676f-7b24-4c7e-849c-97e196465a3c] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:33:50.662768 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-77f480a7-3b99-421d-aa46-f27a48c6a011 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:33:50.664013 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-77f480a7-3b99-421d-aa46-f27a48c6a011 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] [instance: a3dbac58-662d-4720-8bcf-2300f9a9a5d1] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:33:50.671284 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-77f480a7-3b99-421d-aa46-f27a48c6a011 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:33:50.671901 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-77f480a7-3b99-421d-aa46-f27a48c6a011 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:33:50.672806 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-77f480a7-3b99-421d-aa46-f27a48c6a011 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:33:50.673352 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-77f480a7-3b99-421d-aa46-f27a48c6a011 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:33:50.725721 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-e1488338-0d3d-4c45-b988-647380acbdaa tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '986f90dfbad14324b3fffbd790d60a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e487deb7ff45bdbf2cc002d42d12a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:33:50.741640 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-e1488338-0d3d-4c45-b988-647380acbdaa tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] 10.222.0.33 "GET /compute/v2.1/servers/9cdd676f-7b24-4c7e-849c-97e196465a3c" status: 200 len: 1235 microversion: 2.1 time: 0.095137 Jul 18 10:33:50.750082 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 328/656] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:33:50 2022] GET /compute/v2.1/servers/9cdd676f-7b24-4c7e-849c-97e196465a3c => generated 1235 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:33:50.828424 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-77f480a7-3b99-421d-aa46-f27a48c6a011 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a431c9708f4694bc0d514133e76088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a1921237622439bab89676e11477c13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:33:50.836373 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-77f480a7-3b99-421d-aa46-f27a48c6a011 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] 10.222.0.33 "GET /compute/v2.1/servers/a3dbac58-662d-4720-8bcf-2300f9a9a5d1" status: 200 len: 1689 microversion: 2.1 time: 0.178406 Jul 18 10:33:50.836977 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 329/657] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:33:50 2022] GET /compute/v2.1/servers/a3dbac58-662d-4720-8bcf-2300f9a9a5d1 => generated 1689 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:33:51.768463 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-401fdaba-1b96-4a6e-849c-244e346a3516 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:33:51.769049 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-401fdaba-1b96-4a6e-849c-244e346a3516 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] [instance: 9cdd676f-7b24-4c7e-849c-97e196465a3c] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:33:51.777140 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-401fdaba-1b96-4a6e-849c-244e346a3516 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:33:51.777599 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-401fdaba-1b96-4a6e-849c-244e346a3516 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:33:51.778412 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-401fdaba-1b96-4a6e-849c-244e346a3516 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:33:51.779026 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-401fdaba-1b96-4a6e-849c-244e346a3516 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:33:51.855439 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-d02d3765-9a40-4483-b3db-b44501089c32 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:33:51.856199 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-d02d3765-9a40-4483-b3db-b44501089c32 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] [instance: a3dbac58-662d-4720-8bcf-2300f9a9a5d1] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:33:51.863472 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-d02d3765-9a40-4483-b3db-b44501089c32 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:33:51.864177 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-d02d3765-9a40-4483-b3db-b44501089c32 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:33:51.864999 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-d02d3765-9a40-4483-b3db-b44501089c32 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:33:51.865439 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-d02d3765-9a40-4483-b3db-b44501089c32 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:33:52.044117 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-d02d3765-9a40-4483-b3db-b44501089c32 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a431c9708f4694bc0d514133e76088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a1921237622439bab89676e11477c13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:33:52.045615 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-401fdaba-1b96-4a6e-849c-244e346a3516 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '986f90dfbad14324b3fffbd790d60a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e487deb7ff45bdbf2cc002d42d12a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:33:52.052122 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-d02d3765-9a40-4483-b3db-b44501089c32 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] 10.222.0.33 "GET /compute/v2.1/servers/a3dbac58-662d-4720-8bcf-2300f9a9a5d1" status: 200 len: 1621 microversion: 2.1 time: 0.201430 Jul 18 10:33:52.053301 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 330/658] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:33:51 2022] GET /compute/v2.1/servers/a3dbac58-662d-4720-8bcf-2300f9a9a5d1 => generated 1621 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:33:52.053957 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-401fdaba-1b96-4a6e-849c-244e346a3516 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] 10.222.0.33 "GET /compute/v2.1/servers/9cdd676f-7b24-4c7e-849c-97e196465a3c" status: 200 len: 1293 microversion: 2.1 time: 0.291075 Jul 18 10:33:52.054616 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 329/659] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:33:51 2022] GET /compute/v2.1/servers/9cdd676f-7b24-4c7e-849c-97e196465a3c => generated 1293 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:33:52.153681 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [req-868c52d1-05a0-494d-ad55-b4edf21808bd req-20ffaba0-8088-4f37-9260-b56f0053a2ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3dbac58-662d-4720-8bcf-2300f9a9a5d1", "name": "network-vif-deleted", "tag": "280c18f2-df08-4a5c-a1cc-01a91c5d3cfb"}]} {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:33:52.164055 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [req-868c52d1-05a0-494d-ad55-b4edf21808bd req-20ffaba0-8088-4f37-9260-b56f0053a2ef service nova] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:33:52.164794 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [req-868c52d1-05a0-494d-ad55-b4edf21808bd req-20ffaba0-8088-4f37-9260-b56f0053a2ef service nova] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:33:52.178582 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.compute.server_external_events [req-868c52d1-05a0-494d-ad55-b4edf21808bd req-20ffaba0-8088-4f37-9260-b56f0053a2ef service nova] Creating event network-vif-deleted:280c18f2-df08-4a5c-a1cc-01a91c5d3cfb for instance a3dbac58-662d-4720-8bcf-2300f9a9a5d1 on hv-cinder-83754 Jul 18 10:33:52.184843 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [req-868c52d1-05a0-494d-ad55-b4edf21808bd req-20ffaba0-8088-4f37-9260-b56f0053a2ef service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034697 Jul 18 10:33:52.185714 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 331/660] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jul 18 10:33:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:33:53.072056 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-f1a6c5a9-b83c-49ed-b605-7a3413a876b1 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:33:53.072783 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-568c4c45-0dc0-4a4d-a960-1b86abb83042 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:33:53.073169 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-568c4c45-0dc0-4a4d-a960-1b86abb83042 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] [instance: 9cdd676f-7b24-4c7e-849c-97e196465a3c] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:33:53.074130 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-f1a6c5a9-b83c-49ed-b605-7a3413a876b1 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] [instance: a3dbac58-662d-4720-8bcf-2300f9a9a5d1] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:33:53.081248 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-f1a6c5a9-b83c-49ed-b605-7a3413a876b1 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:33:53.081442 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-568c4c45-0dc0-4a4d-a960-1b86abb83042 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:33:53.081794 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-568c4c45-0dc0-4a4d-a960-1b86abb83042 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:33:53.082239 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-f1a6c5a9-b83c-49ed-b605-7a3413a876b1 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:33:53.082599 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-568c4c45-0dc0-4a4d-a960-1b86abb83042 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:33:53.083148 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-568c4c45-0dc0-4a4d-a960-1b86abb83042 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:33:53.083508 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-f1a6c5a9-b83c-49ed-b605-7a3413a876b1 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:33:53.084104 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-f1a6c5a9-b83c-49ed-b605-7a3413a876b1 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:33:53.099056 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.wsgi [None req-f1a6c5a9-b83c-49ed-b605-7a3413a876b1 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] HTTP exception thrown: Instance a3dbac58-662d-4720-8bcf-2300f9a9a5d1 could not be found. Jul 18 10:33:53.100918 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-f1a6c5a9-b83c-49ed-b605-7a3413a876b1 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Request method failure captured: Jul 18 10:33:53.100918 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: request: GET /compute/v2.1/servers/a3dbac58-662d-4720-8bcf-2300f9a9a5d1 HTTP/1.1 Jul 18 10:33:53.100918 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: Accept: application/json Jul 18 10:33:53.100918 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: Accept-Encoding: identity Jul 18 10:33:53.100918 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: Connection: close Jul 18 10:33:53.100918 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: Content-Length: 0 Jul 18 10:33:53.100918 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: Content-Type: application/json Jul 18 10:33:53.100918 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: Host: 10.222.0.33 Jul 18 10:33:53.100918 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: Openstack-System-Scope: None Jul 18 10:33:53.100918 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: User-Agent: python-urllib3/1.26.9 Jul 18 10:33:53.100918 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Auth-Token: gAAAAABi1TXwn_mK_f7kuXECN8SGyXeI6MkiVur1cBGu0x9uwAf9xlFmP_-pUfPg46JxcRhK0sdtXAw2aOkGpoBZqQnqLV_xkZTvI1OQD5pPdoysYJdyciJL2bXUdpnFbLgqC6bxNJTUhgXK9B7t-8gSneKlpBB0M32nX-UxxWq_GmI2i5lMPM8 Jul 18 10:33:53.100918 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Domain-Id: None Jul 18 10:33:53.100918 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Domain-Name: None Jul 18 10:33:53.100918 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Identity-Status: Confirmed Jul 18 10:33:53.100918 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Is-Admin-Project: True Jul 18 10:33:53.100918 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Project-Domain-Id: default Jul 18 10:33:53.100918 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Project-Domain-Name: Default Jul 18 10:33:53.100918 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Project-Id: 8a1921237622439bab89676e11477c13 Jul 18 10:33:53.100918 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-33766307 Jul 18 10:33:53.100918 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Role: member,reader Jul 18 10:33:53.100918 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Roles: member,reader Jul 18 10:33:53.102583 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8a1921237622439bab89676e11477c13"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8a1921237622439bab89676e11477c13"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/8a1921237622439bab89676e11477c13"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_8a1921237622439bab89676e11477c13"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jul 18 10:33:53.102583 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Tenant: tempest-ServerRescueNegativeTestJSON-33766307 Jul 18 10:33:53.102583 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Tenant-Id: 8a1921237622439bab89676e11477c13 Jul 18 10:33:53.102583 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-33766307 Jul 18 10:33:53.102583 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-User: tempest-ServerRescueNegativeTestJSON-33766307-project Jul 18 10:33:53.102583 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-User-Domain-Id: default Jul 18 10:33:53.102583 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-User-Domain-Name: Default Jul 18 10:33:53.102583 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-User-Id: 72a431c9708f4694bc0d514133e76088 Jul 18 10:33:53.102583 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-User-Name: tempest-ServerRescueNegativeTestJSON-33766307-project Jul 18 10:33:53.102583 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: method: > Jul 18 10:33:53.102583 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: exception: Instance a3dbac58-662d-4720-8bcf-2300f9a9a5d1 could not be found. Jul 18 10:33:53.102583 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: action_args: {'id': 'a3dbac58-662d-4720-8bcf-2300f9a9a5d1'} Jul 18 10:33:53.103502 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 10:33:53.103502 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:33:53.103502 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 10:33:53.103502 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 10:33:53.103502 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 10:33:53.103502 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 10:33:53.103502 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 10:33:53.103502 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 10:33:53.103502 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 10:33:53.103502 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 10:33:53.103502 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a3dbac58-662d-4720-8bcf-2300f9a9a5d1 could not be found. Jul 18 10:33:53.103502 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi Jul 18 10:33:53.103502 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:33:53.103502 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi Jul 18 10:33:53.103502 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:33:53.103502 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:33:53.103502 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:33:53.103502 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 10:33:53.103502 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 10:33:53.103502 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 10:33:53.104994 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 10:33:53.104994 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 10:33:53.104994 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 10:33:53.104994 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 10:33:53.104994 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 10:33:53.104994 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 10:33:53.104994 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 10:33:53.104994 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a3dbac58-662d-4720-8bcf-2300f9a9a5d1 could not be found. Jul 18 10:33:53.104994 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi Jul 18 10:33:53.104994 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:33:53.104994 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi Jul 18 10:33:53.104994 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:33:53.104994 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:33:53.104994 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:33:53.104994 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 10:33:53.104994 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 10:33:53.104994 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a3dbac58-662d-4720-8bcf-2300f9a9a5d1 could not be found. Jul 18 10:33:53.104994 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi Jul 18 10:33:53.106969 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-f1a6c5a9-b83c-49ed-b605-7a3413a876b1 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Returning 404 to user: Instance a3dbac58-662d-4720-8bcf-2300f9a9a5d1 could not be found. {{(pid=117879) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 10:33:53.107978 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-f1a6c5a9-b83c-49ed-b605-7a3413a876b1 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] 10.222.0.33 "GET /compute/v2.1/servers/a3dbac58-662d-4720-8bcf-2300f9a9a5d1" status: 404 len: 111 microversion: 2.1 time: 0.040566 Jul 18 10:33:53.108727 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 332/661] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:33:53 2022] GET /compute/v2.1/servers/a3dbac58-662d-4720-8bcf-2300f9a9a5d1 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 10:33:53.116790 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-91bb842f-7c73-4a40-b3eb-14adf1461472 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Calling method '.version_select at 0x7f9f49febf70>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:33:53.137461 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-91bb842f-7c73-4a40-b3eb-14adf1461472 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-843877681" status: 202 len: 0 microversion: 2.1 time: 0.024269 Jul 18 10:33:53.138176 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 333/662] 10.222.0.33 () {58 vars in 1217 bytes} [Mon Jul 18 10:33:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-843877681 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 10:33:53.535853 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-568c4c45-0dc0-4a4d-a960-1b86abb83042 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '986f90dfbad14324b3fffbd790d60a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e487deb7ff45bdbf2cc002d42d12a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:33:53.546371 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-568c4c45-0dc0-4a4d-a960-1b86abb83042 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] 10.222.0.33 "GET /compute/v2.1/servers/9cdd676f-7b24-4c7e-849c-97e196465a3c" status: 200 len: 1361 microversion: 2.1 time: 0.478961 Jul 18 10:33:53.547116 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 330/663] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:33:53 2022] GET /compute/v2.1/servers/9cdd676f-7b24-4c7e-849c-97e196465a3c => generated 1361 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:33:54.216585 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [req-8ad727e7-24cd-4872-b5b4-2d45b9bf5afe req-15e62a9c-6f7f-4ac0-8f03-bc4c98874811 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9cdd676f-7b24-4c7e-849c-97e196465a3c", "tag": "bf588d31-1331-4764-a116-500faf7ec561"}]} {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:33:54.225174 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [req-8ad727e7-24cd-4872-b5b4-2d45b9bf5afe req-15e62a9c-6f7f-4ac0-8f03-bc4c98874811 service nova] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:33:54.225618 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [req-8ad727e7-24cd-4872-b5b4-2d45b9bf5afe req-15e62a9c-6f7f-4ac0-8f03-bc4c98874811 service nova] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:33:54.235719 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.compute.server_external_events [req-8ad727e7-24cd-4872-b5b4-2d45b9bf5afe req-15e62a9c-6f7f-4ac0-8f03-bc4c98874811 service nova] Creating event network-changed:bf588d31-1331-4764-a116-500faf7ec561 for instance 9cdd676f-7b24-4c7e-849c-97e196465a3c on hv-cinder-83754 Jul 18 10:33:54.240268 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [req-8ad727e7-24cd-4872-b5b4-2d45b9bf5afe req-15e62a9c-6f7f-4ac0-8f03-bc4c98874811 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.027866 Jul 18 10:33:54.240879 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 334/664] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jul 18 10:33:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:33:54.563101 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-dc589dd3-6dad-4480-be59-b9bdd24ed2b4 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:33:54.564374 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-dc589dd3-6dad-4480-be59-b9bdd24ed2b4 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] [instance: 9cdd676f-7b24-4c7e-849c-97e196465a3c] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:33:54.570870 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-dc589dd3-6dad-4480-be59-b9bdd24ed2b4 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:33:54.571312 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-dc589dd3-6dad-4480-be59-b9bdd24ed2b4 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:33:54.572104 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-dc589dd3-6dad-4480-be59-b9bdd24ed2b4 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:33:54.572552 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-dc589dd3-6dad-4480-be59-b9bdd24ed2b4 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:33:54.705454 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-dc589dd3-6dad-4480-be59-b9bdd24ed2b4 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '986f90dfbad14324b3fffbd790d60a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e487deb7ff45bdbf2cc002d42d12a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:33:54.712314 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-dc589dd3-6dad-4480-be59-b9bdd24ed2b4 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] 10.222.0.33 "GET /compute/v2.1/servers/9cdd676f-7b24-4c7e-849c-97e196465a3c" status: 200 len: 1361 microversion: 2.1 time: 0.153074 Jul 18 10:33:54.712905 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 331/665] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:33:54 2022] GET /compute/v2.1/servers/9cdd676f-7b24-4c7e-849c-97e196465a3c => generated 1361 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:33:55.730590 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-348044c5-8c72-4bdb-aa92-0196cffadad7 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:33:55.731418 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-348044c5-8c72-4bdb-aa92-0196cffadad7 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] [instance: 9cdd676f-7b24-4c7e-849c-97e196465a3c] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:33:55.737611 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-348044c5-8c72-4bdb-aa92-0196cffadad7 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:33:55.738066 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-348044c5-8c72-4bdb-aa92-0196cffadad7 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:33:55.738833 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-348044c5-8c72-4bdb-aa92-0196cffadad7 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:33:55.739271 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-348044c5-8c72-4bdb-aa92-0196cffadad7 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:33:55.941411 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-348044c5-8c72-4bdb-aa92-0196cffadad7 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '986f90dfbad14324b3fffbd790d60a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e487deb7ff45bdbf2cc002d42d12a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:33:55.948683 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-348044c5-8c72-4bdb-aa92-0196cffadad7 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] 10.222.0.33 "GET /compute/v2.1/servers/9cdd676f-7b24-4c7e-849c-97e196465a3c" status: 200 len: 1361 microversion: 2.1 time: 0.222992 Jul 18 10:33:55.949234 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 335/666] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:33:55 2022] GET /compute/v2.1/servers/9cdd676f-7b24-4c7e-849c-97e196465a3c => generated 1361 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:33:56.349945 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-610f4d13-296c-4dda-818a-0fc31e4eb6f6 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:33:56.350471 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-610f4d13-296c-4dda-818a-0fc31e4eb6f6 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] [instance: 78bb7f95-9846-4a59-9f77-a3fe69005eec] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:33:56.353043 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG dbcounter [-] [117880] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=2 {{(pid=117880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:33:56.358245 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-610f4d13-296c-4dda-818a-0fc31e4eb6f6 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:33:56.358685 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-610f4d13-296c-4dda-818a-0fc31e4eb6f6 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:33:56.359456 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-610f4d13-296c-4dda-818a-0fc31e4eb6f6 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:33:56.359891 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-610f4d13-296c-4dda-818a-0fc31e4eb6f6 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:33:56.386394 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-610f4d13-296c-4dda-818a-0fc31e4eb6f6 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] [instance: 78bb7f95-9846-4a59-9f77-a3fe69005eec] Going to try to terminate instance {{(pid=117880) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 10:33:56.462658 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-610f4d13-296c-4dda-818a-0fc31e4eb6f6 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] 10.222.0.33 "DELETE /compute/v2.1/servers/78bb7f95-9846-4a59-9f77-a3fe69005eec" status: 204 len: 0 microversion: 2.1 time: 0.116345 Jul 18 10:33:56.463432 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 332/667] 10.222.0.33 () {58 vars in 1238 bytes} [Mon Jul 18 10:33:56 2022] DELETE /compute/v2.1/servers/78bb7f95-9846-4a59-9f77-a3fe69005eec => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 10:33:56.472667 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-27c74d7f-813a-4c76-bdc9-74c359c97370 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:33:56.473017 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-27c74d7f-813a-4c76-bdc9-74c359c97370 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] [instance: 78bb7f95-9846-4a59-9f77-a3fe69005eec] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:33:56.479219 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-27c74d7f-813a-4c76-bdc9-74c359c97370 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:33:56.479662 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-27c74d7f-813a-4c76-bdc9-74c359c97370 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:33:56.480417 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-27c74d7f-813a-4c76-bdc9-74c359c97370 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:33:56.480900 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-27c74d7f-813a-4c76-bdc9-74c359c97370 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:33:56.612477 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-27c74d7f-813a-4c76-bdc9-74c359c97370 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a431c9708f4694bc0d514133e76088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a1921237622439bab89676e11477c13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:33:56.619927 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-27c74d7f-813a-4c76-bdc9-74c359c97370 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] 10.222.0.33 "GET /compute/v2.1/servers/78bb7f95-9846-4a59-9f77-a3fe69005eec" status: 200 len: 1506 microversion: 2.1 time: 0.152302 Jul 18 10:33:56.620537 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 336/668] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:33:56 2022] GET /compute/v2.1/servers/78bb7f95-9846-4a59-9f77-a3fe69005eec => generated 1506 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:33:56.966331 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-582becae-3a38-4ad1-bafe-388dcabbedfd tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:33:56.967023 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-582becae-3a38-4ad1-bafe-388dcabbedfd tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] [instance: 9cdd676f-7b24-4c7e-849c-97e196465a3c] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:33:56.973652 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-582becae-3a38-4ad1-bafe-388dcabbedfd tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:33:56.974129 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-582becae-3a38-4ad1-bafe-388dcabbedfd tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:33:56.974889 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-582becae-3a38-4ad1-bafe-388dcabbedfd tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:33:56.975322 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-582becae-3a38-4ad1-bafe-388dcabbedfd tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:33:57.103033 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-582becae-3a38-4ad1-bafe-388dcabbedfd tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '986f90dfbad14324b3fffbd790d60a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e487deb7ff45bdbf2cc002d42d12a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:33:57.110372 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-582becae-3a38-4ad1-bafe-388dcabbedfd tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] 10.222.0.33 "GET /compute/v2.1/servers/9cdd676f-7b24-4c7e-849c-97e196465a3c" status: 200 len: 1361 microversion: 2.1 time: 0.148208 Jul 18 10:33:57.110944 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 333/669] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:33:56 2022] GET /compute/v2.1/servers/9cdd676f-7b24-4c7e-849c-97e196465a3c => generated 1361 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:33:57.636685 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-9b2288dc-7f77-46b8-a64e-945703522fe6 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:33:57.637286 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-9b2288dc-7f77-46b8-a64e-945703522fe6 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] [instance: 78bb7f95-9846-4a59-9f77-a3fe69005eec] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:33:57.644256 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-9b2288dc-7f77-46b8-a64e-945703522fe6 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:33:57.644730 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-9b2288dc-7f77-46b8-a64e-945703522fe6 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:33:57.645483 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-9b2288dc-7f77-46b8-a64e-945703522fe6 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:33:57.645914 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-9b2288dc-7f77-46b8-a64e-945703522fe6 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:33:57.783022 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-9b2288dc-7f77-46b8-a64e-945703522fe6 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a431c9708f4694bc0d514133e76088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a1921237622439bab89676e11477c13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:33:57.790419 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-9b2288dc-7f77-46b8-a64e-945703522fe6 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] 10.222.0.33 "GET /compute/v2.1/servers/78bb7f95-9846-4a59-9f77-a3fe69005eec" status: 200 len: 1506 microversion: 2.1 time: 0.157555 Jul 18 10:33:57.790984 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 337/670] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:33:57 2022] GET /compute/v2.1/servers/78bb7f95-9846-4a59-9f77-a3fe69005eec => generated 1506 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:33:58.127214 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-fdfd52af-9194-48f1-b496-820de2d41eae tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:33:58.127817 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-fdfd52af-9194-48f1-b496-820de2d41eae tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] [instance: 9cdd676f-7b24-4c7e-849c-97e196465a3c] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:33:58.134289 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-fdfd52af-9194-48f1-b496-820de2d41eae tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:33:58.134737 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-fdfd52af-9194-48f1-b496-820de2d41eae tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:33:58.135503 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-fdfd52af-9194-48f1-b496-820de2d41eae tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:33:58.135933 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-fdfd52af-9194-48f1-b496-820de2d41eae tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:33:58.266104 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-fdfd52af-9194-48f1-b496-820de2d41eae tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '986f90dfbad14324b3fffbd790d60a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e487deb7ff45bdbf2cc002d42d12a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:33:58.273372 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-fdfd52af-9194-48f1-b496-820de2d41eae tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] 10.222.0.33 "GET /compute/v2.1/servers/9cdd676f-7b24-4c7e-849c-97e196465a3c" status: 200 len: 1361 microversion: 2.1 time: 0.150519 Jul 18 10:33:58.273935 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 334/671] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:33:58 2022] GET /compute/v2.1/servers/9cdd676f-7b24-4c7e-849c-97e196465a3c => generated 1361 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:33:58.419489 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-c27c7847-100c-484e-ab2d-1b3d5ea14612 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:33:58.419900 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-c27c7847-100c-484e-ab2d-1b3d5ea14612 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] [instance: 54754961-403d-4f99-98c1-727db8528d91] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:33:58.426376 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-c27c7847-100c-484e-ab2d-1b3d5ea14612 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:33:58.426819 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-c27c7847-100c-484e-ab2d-1b3d5ea14612 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:33:58.427572 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-c27c7847-100c-484e-ab2d-1b3d5ea14612 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:33:58.428004 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-c27c7847-100c-484e-ab2d-1b3d5ea14612 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:33:58.450464 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-c27c7847-100c-484e-ab2d-1b3d5ea14612 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] 10.222.0.33 "GET /compute/v2.1/servers/54754961-403d-4f99-98c1-727db8528d91/ips" status: 200 len: 151 microversion: 2.1 time: 0.034840 Jul 18 10:33:58.451009 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 338/672] 10.222.0.33 () {58 vars in 1247 bytes} [Mon Jul 18 10:33:58 2022] GET /compute/v2.1/servers/54754961-403d-4f99-98c1-727db8528d91/ips => generated 151 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:33:58.806831 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-1cc151fa-2952-4aaa-9f38-edcebd8718e6 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:33:58.807437 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-1cc151fa-2952-4aaa-9f38-edcebd8718e6 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] [instance: 78bb7f95-9846-4a59-9f77-a3fe69005eec] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:33:58.814036 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-1cc151fa-2952-4aaa-9f38-edcebd8718e6 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:33:58.814459 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-1cc151fa-2952-4aaa-9f38-edcebd8718e6 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:33:58.815225 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-1cc151fa-2952-4aaa-9f38-edcebd8718e6 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:33:58.815662 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-1cc151fa-2952-4aaa-9f38-edcebd8718e6 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:33:58.998806 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-1cc151fa-2952-4aaa-9f38-edcebd8718e6 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a431c9708f4694bc0d514133e76088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a1921237622439bab89676e11477c13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:33:59.006950 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-1cc151fa-2952-4aaa-9f38-edcebd8718e6 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] 10.222.0.33 "GET /compute/v2.1/servers/78bb7f95-9846-4a59-9f77-a3fe69005eec" status: 200 len: 1506 microversion: 2.1 time: 0.203974 Jul 18 10:33:59.007519 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 335/673] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:33:58 2022] GET /compute/v2.1/servers/78bb7f95-9846-4a59-9f77-a3fe69005eec => generated 1506 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:33:59.259792 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [req-cb4fe71c-8766-4202-be64-9e2997123b75 req-2e850f59-dcd7-4499-ac7c-193fe2936922 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9cdd676f-7b24-4c7e-849c-97e196465a3c", "name": "network-vif-plugged", "status": "completed", "tag": "bf588d31-1331-4764-a116-500faf7ec561"}]} {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:33:59.270697 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [req-cb4fe71c-8766-4202-be64-9e2997123b75 req-2e850f59-dcd7-4499-ac7c-193fe2936922 service nova] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:33:59.271546 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [req-cb4fe71c-8766-4202-be64-9e2997123b75 req-2e850f59-dcd7-4499-ac7c-193fe2936922 service nova] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:33:59.284552 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.compute.server_external_events [req-cb4fe71c-8766-4202-be64-9e2997123b75 req-2e850f59-dcd7-4499-ac7c-193fe2936922 service nova] Creating event network-vif-plugged:bf588d31-1331-4764-a116-500faf7ec561 for instance 9cdd676f-7b24-4c7e-849c-97e196465a3c on hv-cinder-83754 Jul 18 10:33:59.291121 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [req-cb4fe71c-8766-4202-be64-9e2997123b75 req-2e850f59-dcd7-4499-ac7c-193fe2936922 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035309 Jul 18 10:33:59.292402 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 339/674] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jul 18 10:33:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:33:59.294089 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-bb947f2e-ca2c-48bd-8381-da5484165fa5 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:33:59.295945 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-bb947f2e-ca2c-48bd-8381-da5484165fa5 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] [instance: 9cdd676f-7b24-4c7e-849c-97e196465a3c] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:33:59.302973 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-bb947f2e-ca2c-48bd-8381-da5484165fa5 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:33:59.303436 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-bb947f2e-ca2c-48bd-8381-da5484165fa5 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:33:59.304168 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-bb947f2e-ca2c-48bd-8381-da5484165fa5 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:33:59.304629 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-bb947f2e-ca2c-48bd-8381-da5484165fa5 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:33:59.489359 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [req-0dcef041-bf81-4f21-bb29-40d58189e438 req-89e50a97-a94f-4cfb-af3a-7c3ba86f44df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "78bb7f95-9846-4a59-9f77-a3fe69005eec", "name": "network-vif-deleted", "tag": "13cc5a6d-eabb-457d-adf0-12b5abac3083"}]} {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:33:59.499215 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [req-0dcef041-bf81-4f21-bb29-40d58189e438 req-89e50a97-a94f-4cfb-af3a-7c3ba86f44df service nova] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:33:59.500551 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [req-0dcef041-bf81-4f21-bb29-40d58189e438 req-89e50a97-a94f-4cfb-af3a-7c3ba86f44df service nova] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:33:59.513839 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.compute.server_external_events [req-0dcef041-bf81-4f21-bb29-40d58189e438 req-89e50a97-a94f-4cfb-af3a-7c3ba86f44df service nova] Creating event network-vif-deleted:13cc5a6d-eabb-457d-adf0-12b5abac3083 for instance 78bb7f95-9846-4a59-9f77-a3fe69005eec on hv-cinder-83754 Jul 18 10:33:59.520291 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [req-0dcef041-bf81-4f21-bb29-40d58189e438 req-89e50a97-a94f-4cfb-af3a-7c3ba86f44df service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035237 Jul 18 10:33:59.521040 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 340/675] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jul 18 10:33:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 10:33:59.567597 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-bb947f2e-ca2c-48bd-8381-da5484165fa5 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '986f90dfbad14324b3fffbd790d60a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e487deb7ff45bdbf2cc002d42d12a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:33:59.575212 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-bb947f2e-ca2c-48bd-8381-da5484165fa5 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] 10.222.0.33 "GET /compute/v2.1/servers/9cdd676f-7b24-4c7e-849c-97e196465a3c" status: 200 len: 1361 microversion: 2.1 time: 0.288881 Jul 18 10:33:59.575781 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 336/676] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:33:59 2022] GET /compute/v2.1/servers/9cdd676f-7b24-4c7e-849c-97e196465a3c => generated 1361 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:33:59.774411 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-d9fe720e-028d-469a-a4f2-548c813fbc97 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6d2ac038-e65d-400a-8701-2921c2d9d9b3"}} {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:33:59.775544 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-d9fe720e-028d-469a-a4f2-548c813fbc97 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] [instance: 54754961-403d-4f99-98c1-727db8528d91] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:33:59.781851 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-d9fe720e-028d-469a-a4f2-548c813fbc97 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:33:59.782948 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-d9fe720e-028d-469a-a4f2-548c813fbc97 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:33:59.783794 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-d9fe720e-028d-469a-a4f2-548c813fbc97 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:33:59.784232 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-d9fe720e-028d-469a-a4f2-548c813fbc97 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:34:00.024749 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-564702ed-329a-4fef-94c4-62634ac9a174 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:34:00.025355 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-564702ed-329a-4fef-94c4-62634ac9a174 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] [instance: 78bb7f95-9846-4a59-9f77-a3fe69005eec] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:34:00.031254 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-564702ed-329a-4fef-94c4-62634ac9a174 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:34:00.031701 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-564702ed-329a-4fef-94c4-62634ac9a174 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:34:00.033026 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-564702ed-329a-4fef-94c4-62634ac9a174 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:34:00.033457 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-564702ed-329a-4fef-94c4-62634ac9a174 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:34:00.062292 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-564702ed-329a-4fef-94c4-62634ac9a174 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:34:00.062727 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-564702ed-329a-4fef-94c4-62634ac9a174 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:34:00.063167 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.objects.instance [None req-564702ed-329a-4fef-94c4-62634ac9a174 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lazy-loading 'fault' on Instance uuid 78bb7f95-9846-4a59-9f77-a3fe69005eec {{(pid=117880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 10:34:00.103756 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-564702ed-329a-4fef-94c4-62634ac9a174 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a431c9708f4694bc0d514133e76088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a1921237622439bab89676e11477c13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:34:00.111085 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-564702ed-329a-4fef-94c4-62634ac9a174 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] 10.222.0.33 "GET /compute/v2.1/servers/78bb7f95-9846-4a59-9f77-a3fe69005eec" status: 200 len: 1311 microversion: 2.1 time: 0.090299 Jul 18 10:34:00.111635 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 337/677] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:34:00 2022] GET /compute/v2.1/servers/78bb7f95-9846-4a59-9f77-a3fe69005eec => generated 1311 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:34:00.555142 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG dbcounter [-] [117879] Writing DB stats nova_cell0:SELECT=2 {{(pid=117879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:34:00.578007 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG dbcounter [-] [117879] Writing DB stats nova_cell0:SELECT=10 {{(pid=117879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:34:00.592091 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-4fd6e66b-f160-4ada-b70e-e2880bc4a868 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:34:00.592987 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-4fd6e66b-f160-4ada-b70e-e2880bc4a868 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] [instance: 9cdd676f-7b24-4c7e-849c-97e196465a3c] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:34:00.601136 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-4fd6e66b-f160-4ada-b70e-e2880bc4a868 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:34:00.601608 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-4fd6e66b-f160-4ada-b70e-e2880bc4a868 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:34:00.602624 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-4fd6e66b-f160-4ada-b70e-e2880bc4a868 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:34:00.603054 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-4fd6e66b-f160-4ada-b70e-e2880bc4a868 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:34:00.633948 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-d9fe720e-028d-469a-a4f2-548c813fbc97 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] 10.222.0.33 "POST /compute/v2.1/servers/54754961-403d-4f99-98c1-727db8528d91/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.863690 Jul 18 10:34:00.634814 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 341/678] 10.222.0.33 () {60 vars in 1322 bytes} [Mon Jul 18 10:33:59 2022] POST /compute/v2.1/servers/54754961-403d-4f99-98c1-727db8528d91/os-volume_attachments => generated 194 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:34:00.733699 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG dbcounter [-] [117880] Writing DB stats nova_cell0:SELECT=2 {{(pid=117880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:34:00.745103 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-4fd6e66b-f160-4ada-b70e-e2880bc4a868 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '986f90dfbad14324b3fffbd790d60a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e487deb7ff45bdbf2cc002d42d12a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:34:00.752442 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-4fd6e66b-f160-4ada-b70e-e2880bc4a868 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] 10.222.0.33 "GET /compute/v2.1/servers/9cdd676f-7b24-4c7e-849c-97e196465a3c" status: 200 len: 1361 microversion: 2.1 time: 0.164914 Jul 18 10:34:00.753021 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 338/679] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:34:00 2022] GET /compute/v2.1/servers/9cdd676f-7b24-4c7e-849c-97e196465a3c => generated 1361 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:34:01.129016 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-bb6531d4-57a3-462a-be68-e9f3a99936a8 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:34:01.129703 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-bb6531d4-57a3-462a-be68-e9f3a99936a8 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] [instance: 78bb7f95-9846-4a59-9f77-a3fe69005eec] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:34:01.135946 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-bb6531d4-57a3-462a-be68-e9f3a99936a8 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:34:01.136392 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-bb6531d4-57a3-462a-be68-e9f3a99936a8 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:34:01.137190 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-bb6531d4-57a3-462a-be68-e9f3a99936a8 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:34:01.137620 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-bb6531d4-57a3-462a-be68-e9f3a99936a8 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:34:01.150523 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.wsgi [None req-bb6531d4-57a3-462a-be68-e9f3a99936a8 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] HTTP exception thrown: Instance 78bb7f95-9846-4a59-9f77-a3fe69005eec could not be found. Jul 18 10:34:01.152117 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-bb6531d4-57a3-462a-be68-e9f3a99936a8 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Request method failure captured: Jul 18 10:34:01.152117 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: request: GET /compute/v2.1/servers/78bb7f95-9846-4a59-9f77-a3fe69005eec HTTP/1.1 Jul 18 10:34:01.152117 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: Accept: application/json Jul 18 10:34:01.152117 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: Accept-Encoding: identity Jul 18 10:34:01.152117 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: Connection: close Jul 18 10:34:01.152117 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: Content-Length: 0 Jul 18 10:34:01.152117 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: Content-Type: application/json Jul 18 10:34:01.152117 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: Host: 10.222.0.33 Jul 18 10:34:01.152117 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: Openstack-System-Scope: None Jul 18 10:34:01.152117 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: User-Agent: python-urllib3/1.26.9 Jul 18 10:34:01.152117 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Auth-Token: gAAAAABi1TXwn_mK_f7kuXECN8SGyXeI6MkiVur1cBGu0x9uwAf9xlFmP_-pUfPg46JxcRhK0sdtXAw2aOkGpoBZqQnqLV_xkZTvI1OQD5pPdoysYJdyciJL2bXUdpnFbLgqC6bxNJTUhgXK9B7t-8gSneKlpBB0M32nX-UxxWq_GmI2i5lMPM8 Jul 18 10:34:01.152117 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Domain-Id: None Jul 18 10:34:01.152117 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Domain-Name: None Jul 18 10:34:01.152117 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Identity-Status: Confirmed Jul 18 10:34:01.152117 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Is-Admin-Project: True Jul 18 10:34:01.152117 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Project-Domain-Id: default Jul 18 10:34:01.152117 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Project-Domain-Name: Default Jul 18 10:34:01.152117 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Project-Id: 8a1921237622439bab89676e11477c13 Jul 18 10:34:01.152117 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-33766307 Jul 18 10:34:01.152117 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Role: member,reader Jul 18 10:34:01.152117 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Roles: member,reader Jul 18 10:34:01.153768 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8a1921237622439bab89676e11477c13"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8a1921237622439bab89676e11477c13"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/8a1921237622439bab89676e11477c13"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_8a1921237622439bab89676e11477c13"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jul 18 10:34:01.153768 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Tenant: tempest-ServerRescueNegativeTestJSON-33766307 Jul 18 10:34:01.153768 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Tenant-Id: 8a1921237622439bab89676e11477c13 Jul 18 10:34:01.153768 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-33766307 Jul 18 10:34:01.153768 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-User: tempest-ServerRescueNegativeTestJSON-33766307-project Jul 18 10:34:01.153768 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-User-Domain-Id: default Jul 18 10:34:01.153768 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-User-Domain-Name: Default Jul 18 10:34:01.153768 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-User-Id: 72a431c9708f4694bc0d514133e76088 Jul 18 10:34:01.153768 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-User-Name: tempest-ServerRescueNegativeTestJSON-33766307-project Jul 18 10:34:01.153768 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: method: > Jul 18 10:34:01.153768 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: exception: Instance 78bb7f95-9846-4a59-9f77-a3fe69005eec could not be found. Jul 18 10:34:01.153768 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: action_args: {'id': '78bb7f95-9846-4a59-9f77-a3fe69005eec'} Jul 18 10:34:01.154672 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 10:34:01.154672 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:34:01.154672 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 10:34:01.154672 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 10:34:01.154672 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 10:34:01.154672 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 10:34:01.154672 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 10:34:01.154672 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 10:34:01.154672 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 10:34:01.154672 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 10:34:01.154672 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 78bb7f95-9846-4a59-9f77-a3fe69005eec could not be found. Jul 18 10:34:01.154672 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi Jul 18 10:34:01.154672 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:34:01.154672 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi Jul 18 10:34:01.154672 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:34:01.154672 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:34:01.154672 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:34:01.154672 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 10:34:01.154672 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 10:34:01.154672 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 10:34:01.156130 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 10:34:01.156130 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 10:34:01.156130 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 10:34:01.156130 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 10:34:01.156130 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 10:34:01.156130 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 10:34:01.156130 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 10:34:01.156130 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 78bb7f95-9846-4a59-9f77-a3fe69005eec could not be found. Jul 18 10:34:01.156130 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi Jul 18 10:34:01.156130 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:34:01.156130 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi Jul 18 10:34:01.156130 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:34:01.156130 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:34:01.156130 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:34:01.156130 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 10:34:01.156130 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 10:34:01.156130 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 78bb7f95-9846-4a59-9f77-a3fe69005eec could not be found. Jul 18 10:34:01.156130 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi Jul 18 10:34:01.158255 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-bb6531d4-57a3-462a-be68-e9f3a99936a8 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Returning 404 to user: Instance 78bb7f95-9846-4a59-9f77-a3fe69005eec could not be found. {{(pid=117879) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 10:34:01.158255 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-bb6531d4-57a3-462a-be68-e9f3a99936a8 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] 10.222.0.33 "GET /compute/v2.1/servers/78bb7f95-9846-4a59-9f77-a3fe69005eec" status: 404 len: 111 microversion: 2.1 time: 0.029310 Jul 18 10:34:01.158255 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 342/680] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:34:01 2022] GET /compute/v2.1/servers/78bb7f95-9846-4a59-9f77-a3fe69005eec => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 10:34:01.162870 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-c48349c1-72bb-42bc-bbbc-56f033658852 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:34:01.163363 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-c48349c1-72bb-42bc-bbbc-56f033658852 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] [instance: 591fab72-3729-4b6f-af75-cc55766b7eae] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:34:01.169356 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-c48349c1-72bb-42bc-bbbc-56f033658852 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:34:01.169803 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-c48349c1-72bb-42bc-bbbc-56f033658852 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:34:01.170589 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-c48349c1-72bb-42bc-bbbc-56f033658852 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:34:01.171026 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-c48349c1-72bb-42bc-bbbc-56f033658852 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:34:01.196173 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-c48349c1-72bb-42bc-bbbc-56f033658852 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] [instance: 591fab72-3729-4b6f-af75-cc55766b7eae] Going to try to terminate instance {{(pid=117880) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 10:34:01.268841 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-c48349c1-72bb-42bc-bbbc-56f033658852 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] 10.222.0.33 "DELETE /compute/v2.1/servers/591fab72-3729-4b6f-af75-cc55766b7eae" status: 204 len: 0 microversion: 2.1 time: 0.109440 Jul 18 10:34:01.269339 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 339/681] 10.222.0.33 () {58 vars in 1238 bytes} [Mon Jul 18 10:34:01 2022] DELETE /compute/v2.1/servers/591fab72-3729-4b6f-af75-cc55766b7eae => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 10:34:01.277133 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-991e36d1-7b41-4598-8003-eab4d096a1bc tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:34:01.277767 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-991e36d1-7b41-4598-8003-eab4d096a1bc tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] [instance: 591fab72-3729-4b6f-af75-cc55766b7eae] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:34:01.284740 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-991e36d1-7b41-4598-8003-eab4d096a1bc tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:34:01.285186 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-991e36d1-7b41-4598-8003-eab4d096a1bc tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:34:01.285933 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-991e36d1-7b41-4598-8003-eab4d096a1bc tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:34:01.286363 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-991e36d1-7b41-4598-8003-eab4d096a1bc tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:34:01.429957 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-991e36d1-7b41-4598-8003-eab4d096a1bc tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a431c9708f4694bc0d514133e76088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a1921237622439bab89676e11477c13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:34:01.438851 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-991e36d1-7b41-4598-8003-eab4d096a1bc tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] 10.222.0.33 "GET /compute/v2.1/servers/591fab72-3729-4b6f-af75-cc55766b7eae" status: 200 len: 1522 microversion: 2.1 time: 0.164880 Jul 18 10:34:01.439415 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 343/682] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:34:01 2022] GET /compute/v2.1/servers/591fab72-3729-4b6f-af75-cc55766b7eae => generated 1522 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:34:01.770570 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-2b6699b3-8c7f-4625-bd5c-b57b219c7af1 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:34:01.771194 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-2b6699b3-8c7f-4625-bd5c-b57b219c7af1 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] [instance: 9cdd676f-7b24-4c7e-849c-97e196465a3c] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:34:01.777623 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-2b6699b3-8c7f-4625-bd5c-b57b219c7af1 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:34:01.778018 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-2b6699b3-8c7f-4625-bd5c-b57b219c7af1 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:34:01.778778 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-2b6699b3-8c7f-4625-bd5c-b57b219c7af1 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:34:01.779200 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-2b6699b3-8c7f-4625-bd5c-b57b219c7af1 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:34:01.783867 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG dbcounter [-] [117880] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:34:01.912990 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-2b6699b3-8c7f-4625-bd5c-b57b219c7af1 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '986f90dfbad14324b3fffbd790d60a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e487deb7ff45bdbf2cc002d42d12a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:34:01.920498 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-2b6699b3-8c7f-4625-bd5c-b57b219c7af1 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] 10.222.0.33 "GET /compute/v2.1/servers/9cdd676f-7b24-4c7e-849c-97e196465a3c" status: 200 len: 1546 microversion: 2.1 time: 0.154746 Jul 18 10:34:01.921096 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 340/683] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:34:01 2022] GET /compute/v2.1/servers/9cdd676f-7b24-4c7e-849c-97e196465a3c => generated 1546 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:34:01.937113 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-4c77152d-2f3c-4e33-9793-ddb7d9e47a3a tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:34:01.937593 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-4c77152d-2f3c-4e33-9793-ddb7d9e47a3a tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] [instance: 9cdd676f-7b24-4c7e-849c-97e196465a3c] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:34:01.946310 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-4c77152d-2f3c-4e33-9793-ddb7d9e47a3a tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:34:01.946764 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-4c77152d-2f3c-4e33-9793-ddb7d9e47a3a tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:34:01.947573 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-4c77152d-2f3c-4e33-9793-ddb7d9e47a3a tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:34:01.948021 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-4c77152d-2f3c-4e33-9793-ddb7d9e47a3a tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:34:01.950583 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG dbcounter [-] [117879] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=117879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:34:02.043000 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-4c77152d-2f3c-4e33-9793-ddb7d9e47a3a tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] 10.222.0.33 "GET /compute/v2.1/servers/9cdd676f-7b24-4c7e-849c-97e196465a3c/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.109337 Jul 18 10:34:02.044069 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 344/684] 10.222.0.33 () {58 vars in 1274 bytes} [Mon Jul 18 10:34:01 2022] GET /compute/v2.1/servers/9cdd676f-7b24-4c7e-849c-97e196465a3c/os-interface => generated 284 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:34:02.458821 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-3347b55f-4365-4a12-aa33-af5c19ea2502 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:34:02.459434 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-3347b55f-4365-4a12-aa33-af5c19ea2502 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] [instance: 591fab72-3729-4b6f-af75-cc55766b7eae] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:34:02.465430 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-3347b55f-4365-4a12-aa33-af5c19ea2502 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:34:02.465878 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-3347b55f-4365-4a12-aa33-af5c19ea2502 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:34:02.466642 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-3347b55f-4365-4a12-aa33-af5c19ea2502 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:34:02.467076 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-3347b55f-4365-4a12-aa33-af5c19ea2502 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:34:02.741064 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-3347b55f-4365-4a12-aa33-af5c19ea2502 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a431c9708f4694bc0d514133e76088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a1921237622439bab89676e11477c13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:34:02.749058 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-3347b55f-4365-4a12-aa33-af5c19ea2502 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] 10.222.0.33 "GET /compute/v2.1/servers/591fab72-3729-4b6f-af75-cc55766b7eae" status: 200 len: 1522 microversion: 2.1 time: 0.297017 Jul 18 10:34:02.749841 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 341/685] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:34:02 2022] GET /compute/v2.1/servers/591fab72-3729-4b6f-af75-cc55766b7eae => generated 1522 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:34:03.381321 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [req-cf334d93-cd65-465c-bef2-e9aca6baeaa9 req-0e2184b4-c38f-4eac-b80c-ab59558d49e4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9cdd676f-7b24-4c7e-849c-97e196465a3c", "tag": "bf588d31-1331-4764-a116-500faf7ec561"}]} {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:34:03.389658 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [req-cf334d93-cd65-465c-bef2-e9aca6baeaa9 req-0e2184b4-c38f-4eac-b80c-ab59558d49e4 service nova] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:34:03.390218 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [req-cf334d93-cd65-465c-bef2-e9aca6baeaa9 req-0e2184b4-c38f-4eac-b80c-ab59558d49e4 service nova] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:34:03.401239 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.compute.server_external_events [req-cf334d93-cd65-465c-bef2-e9aca6baeaa9 req-0e2184b4-c38f-4eac-b80c-ab59558d49e4 service nova] Creating event network-changed:bf588d31-1331-4764-a116-500faf7ec561 for instance 9cdd676f-7b24-4c7e-849c-97e196465a3c on hv-cinder-83754 Jul 18 10:34:03.406073 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [req-cf334d93-cd65-465c-bef2-e9aca6baeaa9 req-0e2184b4-c38f-4eac-b80c-ab59558d49e4 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028866 Jul 18 10:34:03.407415 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 345/686] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jul 18 10:34:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:34:03.768133 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-dd618e2f-4ec1-425b-a266-bba99c16e0c6 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:34:03.768869 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-dd618e2f-4ec1-425b-a266-bba99c16e0c6 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] [instance: 591fab72-3729-4b6f-af75-cc55766b7eae] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:34:03.775271 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-dd618e2f-4ec1-425b-a266-bba99c16e0c6 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:34:03.775718 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-dd618e2f-4ec1-425b-a266-bba99c16e0c6 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:34:03.776490 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-dd618e2f-4ec1-425b-a266-bba99c16e0c6 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:34:03.776943 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-dd618e2f-4ec1-425b-a266-bba99c16e0c6 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:34:03.919241 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-dd618e2f-4ec1-425b-a266-bba99c16e0c6 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a431c9708f4694bc0d514133e76088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a1921237622439bab89676e11477c13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:34:03.926851 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-dd618e2f-4ec1-425b-a266-bba99c16e0c6 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] 10.222.0.33 "GET /compute/v2.1/servers/591fab72-3729-4b6f-af75-cc55766b7eae" status: 200 len: 1522 microversion: 2.1 time: 0.163101 Jul 18 10:34:03.927418 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 342/687] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:34:03 2022] GET /compute/v2.1/servers/591fab72-3729-4b6f-af75-cc55766b7eae => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:34:05.050131 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-2e397565-fd6a-4ad4-ad67-eefa10ac8db4 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:34:05.050903 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-2e397565-fd6a-4ad4-ad67-eefa10ac8db4 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] [instance: 591fab72-3729-4b6f-af75-cc55766b7eae] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:34:05.057564 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-2e397565-fd6a-4ad4-ad67-eefa10ac8db4 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:34:05.058090 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-2e397565-fd6a-4ad4-ad67-eefa10ac8db4 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:34:05.058933 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-2e397565-fd6a-4ad4-ad67-eefa10ac8db4 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:34:05.059458 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-2e397565-fd6a-4ad4-ad67-eefa10ac8db4 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:34:05.353739 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-2e397565-fd6a-4ad4-ad67-eefa10ac8db4 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72a431c9708f4694bc0d514133e76088', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a1921237622439bab89676e11477c13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:34:05.361328 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-2e397565-fd6a-4ad4-ad67-eefa10ac8db4 tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] 10.222.0.33 "GET /compute/v2.1/servers/591fab72-3729-4b6f-af75-cc55766b7eae" status: 200 len: 1522 microversion: 2.1 time: 0.421650 Jul 18 10:34:05.361896 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 346/688] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:34:04 2022] GET /compute/v2.1/servers/591fab72-3729-4b6f-af75-cc55766b7eae => generated 1522 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:34:05.733592 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [req-8f42e73b-4b73-47d0-bd38-ae5fc55a81fa req-c4796cfa-fd51-42fa-a3c1-b07afe9b3fdf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "591fab72-3729-4b6f-af75-cc55766b7eae", "name": "network-vif-deleted", "tag": "3380728a-d068-450d-b0c7-feb491a61db5"}]} {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:34:05.745425 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [req-8f42e73b-4b73-47d0-bd38-ae5fc55a81fa req-c4796cfa-fd51-42fa-a3c1-b07afe9b3fdf service nova] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:34:05.745873 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [req-8f42e73b-4b73-47d0-bd38-ae5fc55a81fa req-c4796cfa-fd51-42fa-a3c1-b07afe9b3fdf service nova] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:34:05.759210 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.compute.server_external_events [req-8f42e73b-4b73-47d0-bd38-ae5fc55a81fa req-c4796cfa-fd51-42fa-a3c1-b07afe9b3fdf service nova] Creating event network-vif-deleted:3380728a-d068-450d-b0c7-feb491a61db5 for instance 591fab72-3729-4b6f-af75-cc55766b7eae on hv-cinder-83754 Jul 18 10:34:05.764135 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [req-8f42e73b-4b73-47d0-bd38-ae5fc55a81fa req-c4796cfa-fd51-42fa-a3c1-b07afe9b3fdf service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034222 Jul 18 10:34:05.764889 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 343/689] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jul 18 10:34:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 10:34:06.378334 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-719d9475-ec91-41f6-a274-165a6e98ee1b tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:34:06.378943 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-719d9475-ec91-41f6-a274-165a6e98ee1b tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] [instance: 591fab72-3729-4b6f-af75-cc55766b7eae] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:34:06.385371 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-719d9475-ec91-41f6-a274-165a6e98ee1b tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:34:06.385876 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-719d9475-ec91-41f6-a274-165a6e98ee1b tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:34:06.386644 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-719d9475-ec91-41f6-a274-165a6e98ee1b tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:34:06.387082 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-719d9475-ec91-41f6-a274-165a6e98ee1b tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:34:06.400780 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.wsgi [None req-719d9475-ec91-41f6-a274-165a6e98ee1b tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] HTTP exception thrown: Instance 591fab72-3729-4b6f-af75-cc55766b7eae could not be found. Jul 18 10:34:06.402419 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-719d9475-ec91-41f6-a274-165a6e98ee1b tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Request method failure captured: Jul 18 10:34:06.402419 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: request: GET /compute/v2.1/servers/591fab72-3729-4b6f-af75-cc55766b7eae HTTP/1.1 Jul 18 10:34:06.402419 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: Accept: application/json Jul 18 10:34:06.402419 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: Accept-Encoding: identity Jul 18 10:34:06.402419 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: Connection: close Jul 18 10:34:06.402419 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: Content-Length: 0 Jul 18 10:34:06.402419 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: Content-Type: application/json Jul 18 10:34:06.402419 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: Host: 10.222.0.33 Jul 18 10:34:06.402419 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: Openstack-System-Scope: None Jul 18 10:34:06.402419 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: User-Agent: python-urllib3/1.26.9 Jul 18 10:34:06.402419 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Auth-Token: gAAAAABi1TXwn_mK_f7kuXECN8SGyXeI6MkiVur1cBGu0x9uwAf9xlFmP_-pUfPg46JxcRhK0sdtXAw2aOkGpoBZqQnqLV_xkZTvI1OQD5pPdoysYJdyciJL2bXUdpnFbLgqC6bxNJTUhgXK9B7t-8gSneKlpBB0M32nX-UxxWq_GmI2i5lMPM8 Jul 18 10:34:06.402419 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Domain-Id: None Jul 18 10:34:06.402419 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Domain-Name: None Jul 18 10:34:06.402419 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Identity-Status: Confirmed Jul 18 10:34:06.402419 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Is-Admin-Project: True Jul 18 10:34:06.402419 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Project-Domain-Id: default Jul 18 10:34:06.402419 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Project-Domain-Name: Default Jul 18 10:34:06.402419 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Project-Id: 8a1921237622439bab89676e11477c13 Jul 18 10:34:06.402419 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-33766307 Jul 18 10:34:06.402419 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Role: member,reader Jul 18 10:34:06.402419 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Roles: member,reader Jul 18 10:34:06.404058 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8a1921237622439bab89676e11477c13"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8a1921237622439bab89676e11477c13"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/8a1921237622439bab89676e11477c13"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_8a1921237622439bab89676e11477c13"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jul 18 10:34:06.404058 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Tenant: tempest-ServerRescueNegativeTestJSON-33766307 Jul 18 10:34:06.404058 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Tenant-Id: 8a1921237622439bab89676e11477c13 Jul 18 10:34:06.404058 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-33766307 Jul 18 10:34:06.404058 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-User: tempest-ServerRescueNegativeTestJSON-33766307-project Jul 18 10:34:06.404058 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-User-Domain-Id: default Jul 18 10:34:06.404058 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-User-Domain-Name: Default Jul 18 10:34:06.404058 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-User-Id: 72a431c9708f4694bc0d514133e76088 Jul 18 10:34:06.404058 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-User-Name: tempest-ServerRescueNegativeTestJSON-33766307-project Jul 18 10:34:06.404058 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: method: > Jul 18 10:34:06.404058 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: exception: Instance 591fab72-3729-4b6f-af75-cc55766b7eae could not be found. Jul 18 10:34:06.404058 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: action_args: {'id': '591fab72-3729-4b6f-af75-cc55766b7eae'} Jul 18 10:34:06.405171 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 10:34:06.405171 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:34:06.405171 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 10:34:06.405171 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 10:34:06.405171 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 10:34:06.405171 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 10:34:06.405171 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 10:34:06.405171 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 10:34:06.405171 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 10:34:06.405171 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 10:34:06.405171 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 591fab72-3729-4b6f-af75-cc55766b7eae could not be found. Jul 18 10:34:06.405171 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi Jul 18 10:34:06.405171 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:34:06.405171 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi Jul 18 10:34:06.405171 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:34:06.405171 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:34:06.405171 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:34:06.405171 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 10:34:06.405171 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 10:34:06.405171 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 10:34:06.407242 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 10:34:06.407242 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 10:34:06.407242 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 10:34:06.407242 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 10:34:06.407242 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 10:34:06.407242 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 10:34:06.407242 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 10:34:06.407242 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 591fab72-3729-4b6f-af75-cc55766b7eae could not be found. Jul 18 10:34:06.407242 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi Jul 18 10:34:06.407242 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:34:06.407242 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi Jul 18 10:34:06.407242 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:34:06.407242 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:34:06.407242 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:34:06.407242 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 10:34:06.407242 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 10:34:06.407242 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 591fab72-3729-4b6f-af75-cc55766b7eae could not be found. Jul 18 10:34:06.407242 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi Jul 18 10:34:06.408857 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-719d9475-ec91-41f6-a274-165a6e98ee1b tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] Returning 404 to user: Instance 591fab72-3729-4b6f-af75-cc55766b7eae could not be found. {{(pid=117879) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 10:34:06.408857 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-719d9475-ec91-41f6-a274-165a6e98ee1b tempest-ServerRescueNegativeTestJSON-33766307 tempest-ServerRescueNegativeTestJSON-33766307-project] 10.222.0.33 "GET /compute/v2.1/servers/591fab72-3729-4b6f-af75-cc55766b7eae" status: 404 len: 111 microversion: 2.1 time: 0.029494 Jul 18 10:34:06.408857 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 347/690] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:34:06 2022] GET /compute/v2.1/servers/591fab72-3729-4b6f-af75-cc55766b7eae => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 10:34:11.329941 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-f684a063-6a42-4a83-b749-a5c506fee6ea tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6d2ac038-e65d-400a-8701-2921c2d9d9b3"}} {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:34:11.331085 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-f684a063-6a42-4a83-b749-a5c506fee6ea tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] [instance: 54754961-403d-4f99-98c1-727db8528d91] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:34:11.337997 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-f684a063-6a42-4a83-b749-a5c506fee6ea tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:34:11.338442 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-f684a063-6a42-4a83-b749-a5c506fee6ea tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:34:11.339205 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-f684a063-6a42-4a83-b749-a5c506fee6ea tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:34:11.339634 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-f684a063-6a42-4a83-b749-a5c506fee6ea tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:34:11.432952 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.wsgi [None req-f684a063-6a42-4a83-b749-a5c506fee6ea tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] HTTP exception thrown: Invalid volume: volume 6d2ac038-e65d-400a-8701-2921c2d9d9b3 is already attached to instances: 54754961-403d-4f99-98c1-727db8528d91 Jul 18 10:34:11.434680 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-f684a063-6a42-4a83-b749-a5c506fee6ea tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Request method failure captured: Jul 18 10:34:11.434680 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: request: POST /compute/v2.1/servers/54754961-403d-4f99-98c1-727db8528d91/os-volume_attachments HTTP/1.1 Jul 18 10:34:11.434680 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: Accept: application/json Jul 18 10:34:11.434680 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: Accept-Encoding: identity Jul 18 10:34:11.434680 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: Connection: close Jul 18 10:34:11.434680 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: Content-Length: 74 Jul 18 10:34:11.434680 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: Content-Type: application/json Jul 18 10:34:11.434680 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: Host: 10.222.0.33 Jul 18 10:34:11.434680 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: Openstack-System-Scope: None Jul 18 10:34:11.434680 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: User-Agent: python-urllib3/1.26.9 Jul 18 10:34:11.434680 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Auth-Token: gAAAAABi1TXs5d9KA6TlIG1Li_VNjhkDxvVxs6ByaKH91Tp5cEYBI8OTiNSNI40UEe5MBLfNqlyuYAjUMpiV_qMg9jtmq9fJwxP3wvSLbrM9kN7Z4diK5bpD5WWlO_9PNIu02mzK2QxOqaTdn-MDBEh-IwIUUSwgtjyQOUrIhUK0fhFwotym42k Jul 18 10:34:11.434680 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Domain-Id: None Jul 18 10:34:11.434680 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Domain-Name: None Jul 18 10:34:11.434680 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Identity-Status: Confirmed Jul 18 10:34:11.434680 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Is-Admin-Project: True Jul 18 10:34:11.434680 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Project-Domain-Id: default Jul 18 10:34:11.434680 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Project-Domain-Name: Default Jul 18 10:34:11.434680 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Project-Id: 1cf3d5bfe9a745f38372c42c9cfa1f63 Jul 18 10:34:11.434680 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Project-Name: tempest-AttachVolumeNegativeTest-653274830 Jul 18 10:34:11.434680 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Role: member,reader Jul 18 10:34:11.434680 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Roles: member,reader Jul 18 10:34:11.436312 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1cf3d5bfe9a745f38372c42c9cfa1f63"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1cf3d5bfe9a745f38372c42c9cfa1f63"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/1cf3d5bfe9a745f38372c42c9cfa1f63"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_1cf3d5bfe9a745f38372c42c9cfa1f63"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jul 18 10:34:11.436312 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Tenant: tempest-AttachVolumeNegativeTest-653274830 Jul 18 10:34:11.436312 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Tenant-Id: 1cf3d5bfe9a745f38372c42c9cfa1f63 Jul 18 10:34:11.436312 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-653274830 Jul 18 10:34:11.436312 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-User: tempest-AttachVolumeNegativeTest-653274830-project Jul 18 10:34:11.436312 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-User-Domain-Id: default Jul 18 10:34:11.436312 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-User-Domain-Name: Default Jul 18 10:34:11.436312 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-User-Id: f25c72896a2d4d619e5ad4b5a0a79aa6 Jul 18 10:34:11.436312 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-User-Name: tempest-AttachVolumeNegativeTest-653274830-project Jul 18 10:34:11.436312 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: Jul 18 10:34:11.436312 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: {"volumeAttachment": {"volumeId": "6d2ac038-e65d-400a-8701-2921c2d9d9b3"}} Jul 18 10:34:11.436312 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: method: > Jul 18 10:34:11.437157 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: exception: Invalid volume: volume 6d2ac038-e65d-400a-8701-2921c2d9d9b3 is already attached to instances: 54754961-403d-4f99-98c1-727db8528d91 Jul 18 10:34:11.437157 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: action_args: {'server_id': '54754961-403d-4f99-98c1-727db8528d91', 'body': {'volumeAttachment': {'volumeId': '6d2ac038-e65d-400a-8701-2921c2d9d9b3'}}} Jul 18 10:34:11.437157 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 10:34:11.437157 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:34:11.437157 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 18 10:34:11.437157 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 18 10:34:11.437157 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 18 10:34:11.437157 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 18 10:34:11.437157 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 18 10:34:11.437157 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 18 10:34:11.437157 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jul 18 10:34:11.437157 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 18 10:34:11.437157 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jul 18 10:34:11.437157 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 18 10:34:11.437157 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 6d2ac038-e65d-400a-8701-2921c2d9d9b3 is already attached to instances: 54754961-403d-4f99-98c1-727db8528d91 Jul 18 10:34:11.437157 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi Jul 18 10:34:11.437157 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:34:11.437157 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi Jul 18 10:34:11.437157 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:34:11.438389 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:34:11.438389 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:34:11.438389 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 10:34:11.438389 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 10:34:11.438389 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 10:34:11.438389 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 10:34:11.438389 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 10:34:11.438389 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 10:34:11.438389 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 10:34:11.438389 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 10:34:11.438389 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 10:34:11.438389 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 10:34:11.438389 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 18 10:34:11.438389 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 18 10:34:11.438389 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 6d2ac038-e65d-400a-8701-2921c2d9d9b3 is already attached to instances: 54754961-403d-4f99-98c1-727db8528d91 Jul 18 10:34:11.438389 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi Jul 18 10:34:11.438389 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:34:11.438389 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi Jul 18 10:34:11.438389 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:34:11.438389 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:34:11.439569 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:34:11.439569 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 10:34:11.439569 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 10:34:11.439569 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 6d2ac038-e65d-400a-8701-2921c2d9d9b3 is already attached to instances: 54754961-403d-4f99-98c1-727db8528d91 Jul 18 10:34:11.439569 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi Jul 18 10:34:11.439569 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-f684a063-6a42-4a83-b749-a5c506fee6ea tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Returning 400 to user: Invalid volume: volume 6d2ac038-e65d-400a-8701-2921c2d9d9b3 is already attached to instances: 54754961-403d-4f99-98c1-727db8528d91 {{(pid=117880) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 10:34:11.439569 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-f684a063-6a42-4a83-b749-a5c506fee6ea tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] 10.222.0.33 "POST /compute/v2.1/servers/54754961-403d-4f99-98c1-727db8528d91/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.110639 Jul 18 10:34:11.439569 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 344/691] 10.222.0.33 () {60 vars in 1322 bytes} [Mon Jul 18 10:34:11 2022] POST /compute/v2.1/servers/54754961-403d-4f99-98c1-727db8528d91/os-volume_attachments => generated 174 bytes in 112 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 18 10:34:11.522610 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-a5febbc7-6b90-4ed4-8f0a-a1000b6b7f2f tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:34:11.523250 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-a5febbc7-6b90-4ed4-8f0a-a1000b6b7f2f tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] [instance: 54754961-403d-4f99-98c1-727db8528d91] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:34:11.530584 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-a5febbc7-6b90-4ed4-8f0a-a1000b6b7f2f tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:34:11.531312 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-a5febbc7-6b90-4ed4-8f0a-a1000b6b7f2f tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:34:11.532840 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-a5febbc7-6b90-4ed4-8f0a-a1000b6b7f2f tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:34:11.533290 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-a5febbc7-6b90-4ed4-8f0a-a1000b6b7f2f tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:34:11.632938 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.objects.instance [None req-a5febbc7-6b90-4ed4-8f0a-a1000b6b7f2f tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lazy-loading 'services' on Instance uuid 54754961-403d-4f99-98c1-727db8528d91 {{(pid=117879) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 10:34:11.710787 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-a5febbc7-6b90-4ed4-8f0a-a1000b6b7f2f tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] 10.222.0.33 "DELETE /compute/v2.1/servers/54754961-403d-4f99-98c1-727db8528d91/os-volume_attachments/6d2ac038-e65d-400a-8701-2921c2d9d9b3" status: 202 len: 0 microversion: 2.1 time: 0.206029 Jul 18 10:34:11.711648 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 348/692] 10.222.0.33 () {58 vars in 1415 bytes} [Mon Jul 18 10:34:11 2022] DELETE /compute/v2.1/servers/54754961-403d-4f99-98c1-727db8528d91/os-volume_attachments/6d2ac038-e65d-400a-8701-2921c2d9d9b3 => generated 0 bytes in 208 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 10:34:11.720599 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-d1743cf1-9ae9-4e1e-92e2-dfc45a1bcce4 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:34:11.721585 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-d1743cf1-9ae9-4e1e-92e2-dfc45a1bcce4 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] [instance: 54754961-403d-4f99-98c1-727db8528d91] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:34:11.730153 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-d1743cf1-9ae9-4e1e-92e2-dfc45a1bcce4 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:34:11.730767 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-d1743cf1-9ae9-4e1e-92e2-dfc45a1bcce4 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:34:11.731864 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-d1743cf1-9ae9-4e1e-92e2-dfc45a1bcce4 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:34:11.732529 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-d1743cf1-9ae9-4e1e-92e2-dfc45a1bcce4 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:34:11.766484 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-d1743cf1-9ae9-4e1e-92e2-dfc45a1bcce4 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] 10.222.0.33 "GET /compute/v2.1/servers/54754961-403d-4f99-98c1-727db8528d91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050249 Jul 18 10:34:11.776622 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 345/693] 10.222.0.33 () {58 vars in 1301 bytes} [Mon Jul 18 10:34:11 2022] GET /compute/v2.1/servers/54754961-403d-4f99-98c1-727db8528d91/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:34:12.779590 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-4aba2fc6-aee0-4872-96e1-9d140fdf2ab6 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:34:12.781312 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-4aba2fc6-aee0-4872-96e1-9d140fdf2ab6 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] [instance: 54754961-403d-4f99-98c1-727db8528d91] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:34:12.789293 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-4aba2fc6-aee0-4872-96e1-9d140fdf2ab6 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:34:12.789990 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-4aba2fc6-aee0-4872-96e1-9d140fdf2ab6 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:34:12.790780 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-4aba2fc6-aee0-4872-96e1-9d140fdf2ab6 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:34:12.791218 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-4aba2fc6-aee0-4872-96e1-9d140fdf2ab6 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:34:12.823865 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-4aba2fc6-aee0-4872-96e1-9d140fdf2ab6 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] 10.222.0.33 "GET /compute/v2.1/servers/54754961-403d-4f99-98c1-727db8528d91/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048992 Jul 18 10:34:12.824858 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 349/694] 10.222.0.33 () {58 vars in 1301 bytes} [Mon Jul 18 10:34:12 2022] GET /compute/v2.1/servers/54754961-403d-4f99-98c1-727db8528d91/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 10:34:12.887237 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-2b4bb95e-6d15-4007-a9c5-99eee149daef tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:34:12.888265 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-2b4bb95e-6d15-4007-a9c5-99eee149daef tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] [instance: 54754961-403d-4f99-98c1-727db8528d91] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:34:12.896470 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-2b4bb95e-6d15-4007-a9c5-99eee149daef tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:34:12.896969 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-2b4bb95e-6d15-4007-a9c5-99eee149daef tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:34:12.897919 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-2b4bb95e-6d15-4007-a9c5-99eee149daef tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:34:12.898354 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-2b4bb95e-6d15-4007-a9c5-99eee149daef tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:34:12.932067 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-2b4bb95e-6d15-4007-a9c5-99eee149daef tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] [instance: 54754961-403d-4f99-98c1-727db8528d91] Going to try to terminate instance {{(pid=117880) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 10:34:13.025709 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-2b4bb95e-6d15-4007-a9c5-99eee149daef tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] 10.222.0.33 "DELETE /compute/v2.1/servers/54754961-403d-4f99-98c1-727db8528d91" status: 204 len: 0 microversion: 2.1 time: 0.141473 Jul 18 10:34:13.027070 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 346/695] 10.222.0.33 () {58 vars in 1238 bytes} [Mon Jul 18 10:34:12 2022] DELETE /compute/v2.1/servers/54754961-403d-4f99-98c1-727db8528d91 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 10:34:13.040280 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-08fdce26-f5fa-444a-ac2f-f422a5bdcbd3 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:34:13.041186 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-08fdce26-f5fa-444a-ac2f-f422a5bdcbd3 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] [instance: 54754961-403d-4f99-98c1-727db8528d91] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:34:13.050788 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-08fdce26-f5fa-444a-ac2f-f422a5bdcbd3 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:34:13.051475 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-08fdce26-f5fa-444a-ac2f-f422a5bdcbd3 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:34:13.052576 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-08fdce26-f5fa-444a-ac2f-f422a5bdcbd3 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:34:13.053163 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-08fdce26-f5fa-444a-ac2f-f422a5bdcbd3 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:34:13.274282 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-08fdce26-f5fa-444a-ac2f-f422a5bdcbd3 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f25c72896a2d4d619e5ad4b5a0a79aa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cf3d5bfe9a745f38372c42c9cfa1f63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:34:13.285703 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-08fdce26-f5fa-444a-ac2f-f422a5bdcbd3 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] 10.222.0.33 "GET /compute/v2.1/servers/54754961-403d-4f99-98c1-727db8528d91" status: 200 len: 1681 microversion: 2.1 time: 0.252450 Jul 18 10:34:13.286555 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 350/696] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:34:13 2022] GET /compute/v2.1/servers/54754961-403d-4f99-98c1-727db8528d91 => generated 1681 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:34:14.304327 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-ab41104e-85a3-48ef-8f92-519482aa171b tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:34:14.305069 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-ab41104e-85a3-48ef-8f92-519482aa171b tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] [instance: 54754961-403d-4f99-98c1-727db8528d91] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:34:14.311977 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-ab41104e-85a3-48ef-8f92-519482aa171b tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:34:14.312434 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-ab41104e-85a3-48ef-8f92-519482aa171b tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:34:14.314001 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-ab41104e-85a3-48ef-8f92-519482aa171b tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:34:14.314487 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-ab41104e-85a3-48ef-8f92-519482aa171b tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:34:14.514408 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-ab41104e-85a3-48ef-8f92-519482aa171b tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f25c72896a2d4d619e5ad4b5a0a79aa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cf3d5bfe9a745f38372c42c9cfa1f63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:34:14.523155 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-ab41104e-85a3-48ef-8f92-519482aa171b tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] 10.222.0.33 "GET /compute/v2.1/servers/54754961-403d-4f99-98c1-727db8528d91" status: 200 len: 1681 microversion: 2.1 time: 0.222982 Jul 18 10:34:14.523949 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 347/697] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:34:14 2022] GET /compute/v2.1/servers/54754961-403d-4f99-98c1-727db8528d91 => generated 1681 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:34:15.047571 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-8856a215-166d-4ff7-899e-38c4836647c4 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-2104931263"}} {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:34:15.048101 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-8856a215-166d-4ff7-899e-38c4836647c4 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] [instance: 83b29c39-45ca-4cb3-ad7d-f7bd47bfe667] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:34:15.059445 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-8856a215-166d-4ff7-899e-38c4836647c4 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:34:15.059894 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-8856a215-166d-4ff7-899e-38c4836647c4 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:34:15.060780 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-8856a215-166d-4ff7-899e-38c4836647c4 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:34:15.061207 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-8856a215-166d-4ff7-899e-38c4836647c4 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:34:15.318704 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.network.security_group_api [None req-8856a215-166d-4ff7-899e-38c4836647c4 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Removing security group 80b87658-1b7e-4ad8-a67e-54037b81d5ba from port 8763c93e-265a-48e3-9444-a3c09c88377b Jul 18 10:34:15.370691 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-8bcc35f4-619c-4779-b185-833134f921ba tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Action: 'create', calling method: .version_select at 0x7f9f49f3c700>, body: {"keypair": {"name": "tempest-keypair-1613020057", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFmlD210a6nvfjjcYSJpguC27Kfaoig5g6//EYuUY1xMHj5feChXQ0hP35x1wHVZLHkaFNCMBmkzAUj1ul7rHs+facT0L0HDNLgZofSuWRGZftrJNWTOWIdzRYLangngGA=="}} {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:34:15.388538 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.quota [None req-8bcc35f4-619c-4779-b185-833134f921ba tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Getting quotas for project feefb94984d54cbbaa70b963d956a520. Resources: {'key_pairs'} {{(pid=117880) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 10:34:15.392739 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.quota [None req-8bcc35f4-619c-4779-b185-833134f921ba tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Getting quotas for user cacc328f0f3540299310a0e53afe6acb and project feefb94984d54cbbaa70b963d956a520. Resources: {'key_pairs'} {{(pid=117880) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 10:34:15.428197 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-8bcc35f4-619c-4779-b185-833134f921ba tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.243265 Jul 18 10:34:15.429422 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 348/698] 10.222.0.33 () {62 vars in 1199 bytes} [Mon Jul 18 10:34:15 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 245 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 18 10:34:15.544825 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-b987e2fc-c7e8-4d0a-98c6-2f1bfb79d319 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:34:15.545561 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-b987e2fc-c7e8-4d0a-98c6-2f1bfb79d319 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] [instance: 54754961-403d-4f99-98c1-727db8528d91] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:34:15.555373 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-b987e2fc-c7e8-4d0a-98c6-2f1bfb79d319 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:34:15.556034 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-b987e2fc-c7e8-4d0a-98c6-2f1bfb79d319 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:34:15.561141 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-b987e2fc-c7e8-4d0a-98c6-2f1bfb79d319 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:34:15.561758 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-b987e2fc-c7e8-4d0a-98c6-2f1bfb79d319 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:34:15.997429 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-b987e2fc-c7e8-4d0a-98c6-2f1bfb79d319 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f25c72896a2d4d619e5ad4b5a0a79aa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cf3d5bfe9a745f38372c42c9cfa1f63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:34:16.007613 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-b987e2fc-c7e8-4d0a-98c6-2f1bfb79d319 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] 10.222.0.33 "GET /compute/v2.1/servers/54754961-403d-4f99-98c1-727db8528d91" status: 200 len: 1681 microversion: 2.1 time: 0.470000 Jul 18 10:34:16.008610 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 349/699] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:34:15 2022] GET /compute/v2.1/servers/54754961-403d-4f99-98c1-727db8528d91 => generated 1681 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:34:16.190461 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-8856a215-166d-4ff7-899e-38c4836647c4 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] 10.222.0.33 "POST /compute/v2.1/servers/83b29c39-45ca-4cb3-ad7d-f7bd47bfe667/action" status: 202 len: 0 microversion: 2.1 time: 1.145316 Jul 18 10:34:16.196645 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [req-e282eb69-46fe-4f23-a8dc-9feee34553f5 req-a38a153c-2a91-4453-86f1-161eae7a6b6e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "83b29c39-45ca-4cb3-ad7d-f7bd47bfe667", "tag": "8763c93e-265a-48e3-9444-a3c09c88377b"}]} {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:34:16.198719 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 351/700] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Jul 18 10:34:15 2022] POST /compute/v2.1/servers/83b29c39-45ca-4cb3-ad7d-f7bd47bfe667/action => generated 0 bytes in 1157 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 10:34:16.221407 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [req-e282eb69-46fe-4f23-a8dc-9feee34553f5 req-a38a153c-2a91-4453-86f1-161eae7a6b6e service nova] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:34:16.222375 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [req-e282eb69-46fe-4f23-a8dc-9feee34553f5 req-a38a153c-2a91-4453-86f1-161eae7a6b6e service nova] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:34:16.242409 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.compute.server_external_events [req-e282eb69-46fe-4f23-a8dc-9feee34553f5 req-a38a153c-2a91-4453-86f1-161eae7a6b6e service nova] Creating event network-changed:8763c93e-265a-48e3-9444-a3c09c88377b for instance 83b29c39-45ca-4cb3-ad7d-f7bd47bfe667 on hv-cinder-83754 Jul 18 10:34:16.255914 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [req-e282eb69-46fe-4f23-a8dc-9feee34553f5 req-a38a153c-2a91-4453-86f1-161eae7a6b6e service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062161 Jul 18 10:34:16.257185 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 350/701] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jul 18 10:34:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 10:34:17.026121 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-b09cf594-6769-41da-b8a8-c91e96811a7f tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:34:17.026735 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-b09cf594-6769-41da-b8a8-c91e96811a7f tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] [instance: 54754961-403d-4f99-98c1-727db8528d91] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:34:17.039992 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-b09cf594-6769-41da-b8a8-c91e96811a7f tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:34:17.040449 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-b09cf594-6769-41da-b8a8-c91e96811a7f tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:34:17.046760 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-b09cf594-6769-41da-b8a8-c91e96811a7f tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:34:17.047519 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-b09cf594-6769-41da-b8a8-c91e96811a7f tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:34:17.139921 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-b09cf594-6769-41da-b8a8-c91e96811a7f tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f25c72896a2d4d619e5ad4b5a0a79aa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cf3d5bfe9a745f38372c42c9cfa1f63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:34:17.152910 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-b09cf594-6769-41da-b8a8-c91e96811a7f tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] 10.222.0.33 "GET /compute/v2.1/servers/54754961-403d-4f99-98c1-727db8528d91" status: 200 len: 1325 microversion: 2.1 time: 0.130979 Jul 18 10:34:17.156281 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 352/702] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:34:17 2022] GET /compute/v2.1/servers/54754961-403d-4f99-98c1-727db8528d91 => generated 1325 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:34:17.958110 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-eebd8e3e-059f-4f94-9d32-fb6bf5b7ca94 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1278129475", "imageRef": "2cb02169-9999-411b-8c74-f88c068960fc", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "247d0ee0-142b-4d40-8e91-ea541c052e58"}], "security_groups": [{"name": "tempest-securitygroup--295838388"}], "key_name": "tempest-keypair-1613020057", "user_data": "}} {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:34:18.091094 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.network.neutron [None req-eebd8e3e-059f-4f94-9d32-fb6bf5b7ca94 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] validate_networks() for [('247d0ee0-142b-4d40-8e91-ea541c052e58', None, None, None, None, None)] {{(pid=117880) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 10:34:18.174141 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-edfdb53a-4b2b-4343-bcdc-d5069fe3e1ba tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:34:18.181299 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-edfdb53a-4b2b-4343-bcdc-d5069fe3e1ba tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] [instance: 54754961-403d-4f99-98c1-727db8528d91] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:34:18.196609 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-edfdb53a-4b2b-4343-bcdc-d5069fe3e1ba tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:34:18.200633 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-edfdb53a-4b2b-4343-bcdc-d5069fe3e1ba tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:34:18.206985 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-edfdb53a-4b2b-4343-bcdc-d5069fe3e1ba tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:34:18.207795 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-edfdb53a-4b2b-4343-bcdc-d5069fe3e1ba tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:34:18.231392 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.wsgi [None req-edfdb53a-4b2b-4343-bcdc-d5069fe3e1ba tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] HTTP exception thrown: Instance 54754961-403d-4f99-98c1-727db8528d91 could not be found. Jul 18 10:34:18.233220 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-edfdb53a-4b2b-4343-bcdc-d5069fe3e1ba tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Request method failure captured: Jul 18 10:34:18.233220 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: request: GET /compute/v2.1/servers/54754961-403d-4f99-98c1-727db8528d91 HTTP/1.1 Jul 18 10:34:18.233220 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: Accept: application/json Jul 18 10:34:18.233220 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: Accept-Encoding: identity Jul 18 10:34:18.233220 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: Connection: close Jul 18 10:34:18.233220 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: Content-Length: 0 Jul 18 10:34:18.233220 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: Content-Type: application/json Jul 18 10:34:18.233220 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: Host: 10.222.0.33 Jul 18 10:34:18.233220 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: Openstack-System-Scope: None Jul 18 10:34:18.233220 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: User-Agent: python-urllib3/1.26.9 Jul 18 10:34:18.233220 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Auth-Token: gAAAAABi1TXs5d9KA6TlIG1Li_VNjhkDxvVxs6ByaKH91Tp5cEYBI8OTiNSNI40UEe5MBLfNqlyuYAjUMpiV_qMg9jtmq9fJwxP3wvSLbrM9kN7Z4diK5bpD5WWlO_9PNIu02mzK2QxOqaTdn-MDBEh-IwIUUSwgtjyQOUrIhUK0fhFwotym42k Jul 18 10:34:18.233220 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Domain-Id: None Jul 18 10:34:18.233220 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Domain-Name: None Jul 18 10:34:18.233220 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Identity-Status: Confirmed Jul 18 10:34:18.233220 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Is-Admin-Project: True Jul 18 10:34:18.233220 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Project-Domain-Id: default Jul 18 10:34:18.233220 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Project-Domain-Name: Default Jul 18 10:34:18.233220 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Project-Id: 1cf3d5bfe9a745f38372c42c9cfa1f63 Jul 18 10:34:18.233220 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Project-Name: tempest-AttachVolumeNegativeTest-653274830 Jul 18 10:34:18.233220 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Role: member,reader Jul 18 10:34:18.233220 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Roles: member,reader Jul 18 10:34:18.235879 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1cf3d5bfe9a745f38372c42c9cfa1f63"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1cf3d5bfe9a745f38372c42c9cfa1f63"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/1cf3d5bfe9a745f38372c42c9cfa1f63"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_1cf3d5bfe9a745f38372c42c9cfa1f63"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jul 18 10:34:18.235879 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Tenant: tempest-AttachVolumeNegativeTest-653274830 Jul 18 10:34:18.235879 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Tenant-Id: 1cf3d5bfe9a745f38372c42c9cfa1f63 Jul 18 10:34:18.235879 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-653274830 Jul 18 10:34:18.235879 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-User: tempest-AttachVolumeNegativeTest-653274830-project Jul 18 10:34:18.235879 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-User-Domain-Id: default Jul 18 10:34:18.235879 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-User-Domain-Name: Default Jul 18 10:34:18.235879 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-User-Id: f25c72896a2d4d619e5ad4b5a0a79aa6 Jul 18 10:34:18.235879 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-User-Name: tempest-AttachVolumeNegativeTest-653274830-project Jul 18 10:34:18.235879 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: method: > Jul 18 10:34:18.235879 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: exception: Instance 54754961-403d-4f99-98c1-727db8528d91 could not be found. Jul 18 10:34:18.235879 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: action_args: {'id': '54754961-403d-4f99-98c1-727db8528d91'} Jul 18 10:34:18.236812 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 10:34:18.236812 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:34:18.236812 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 10:34:18.236812 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 10:34:18.236812 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 10:34:18.236812 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 10:34:18.236812 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 10:34:18.236812 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 10:34:18.236812 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 10:34:18.236812 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 10:34:18.236812 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 54754961-403d-4f99-98c1-727db8528d91 could not be found. Jul 18 10:34:18.236812 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi Jul 18 10:34:18.236812 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:34:18.236812 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi Jul 18 10:34:18.236812 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:34:18.236812 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:34:18.236812 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:34:18.236812 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 10:34:18.236812 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 10:34:18.236812 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 10:34:18.238240 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 10:34:18.238240 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 10:34:18.238240 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 10:34:18.238240 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 10:34:18.238240 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 10:34:18.238240 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 10:34:18.238240 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 10:34:18.238240 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 54754961-403d-4f99-98c1-727db8528d91 could not be found. Jul 18 10:34:18.238240 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi Jul 18 10:34:18.238240 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:34:18.238240 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi Jul 18 10:34:18.238240 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:34:18.238240 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:34:18.238240 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:34:18.238240 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 10:34:18.238240 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 10:34:18.238240 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 54754961-403d-4f99-98c1-727db8528d91 could not be found. Jul 18 10:34:18.238240 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi Jul 18 10:34:18.240767 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-edfdb53a-4b2b-4343-bcdc-d5069fe3e1ba tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Returning 404 to user: Instance 54754961-403d-4f99-98c1-727db8528d91 could not be found. {{(pid=117879) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 10:34:18.243201 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-edfdb53a-4b2b-4343-bcdc-d5069fe3e1ba tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] 10.222.0.33 "GET /compute/v2.1/servers/54754961-403d-4f99-98c1-727db8528d91" status: 404 len: 111 microversion: 2.1 time: 0.072904 Jul 18 10:34:18.247579 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 353/703] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:34:18 2022] GET /compute/v2.1/servers/54754961-403d-4f99-98c1-727db8528d91 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 10:34:18.252420 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-92f43b7c-7079-4699-8b68-be5334fd9b88 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Calling method '.version_select at 0x7f9f4a193040>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:34:18.282965 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-92f43b7c-7079-4699-8b68-be5334fd9b88 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1196383884" status: 202 len: 0 microversion: 2.1 time: 0.034166 Jul 18 10:34:18.287514 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 354/704] 10.222.0.33 () {58 vars in 1220 bytes} [Mon Jul 18 10:34:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1196383884 => generated 0 bytes in 39 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 10:34:18.301187 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [req-ea5239a7-61a8-422a-9e67-6f277ba8d840 req-93c92979-9fb1-48ae-9edc-699f3f5ef5f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "54754961-403d-4f99-98c1-727db8528d91", "name": "network-vif-deleted", "tag": "ad0604e9-a3b4-440c-b590-c9d4898189de"}]} {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:34:18.323745 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [req-ea5239a7-61a8-422a-9e67-6f277ba8d840 req-93c92979-9fb1-48ae-9edc-699f3f5ef5f8 service nova] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:34:18.331040 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [req-ea5239a7-61a8-422a-9e67-6f277ba8d840 req-93c92979-9fb1-48ae-9edc-699f3f5ef5f8 service nova] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:34:18.351318 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.compute.server_external_events [req-ea5239a7-61a8-422a-9e67-6f277ba8d840 req-93c92979-9fb1-48ae-9edc-699f3f5ef5f8 service nova] Creating event network-vif-deleted:ad0604e9-a3b4-440c-b590-c9d4898189de for instance 54754961-403d-4f99-98c1-727db8528d91 on hv-cinder-83754 Jul 18 10:34:18.365030 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [req-ea5239a7-61a8-422a-9e67-6f277ba8d840 req-93c92979-9fb1-48ae-9edc-699f3f5ef5f8 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069991 Jul 18 10:34:18.365707 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 355/705] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jul 18 10:34:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:34:18.643295 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-c7f936b0-4be0-4a77-baeb-2b4998f6bf19 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:34:18.644237 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-c7f936b0-4be0-4a77-baeb-2b4998f6bf19 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] [instance: 83b29c39-45ca-4cb3-ad7d-f7bd47bfe667] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:34:18.650972 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-c7f936b0-4be0-4a77-baeb-2b4998f6bf19 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:34:18.651765 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-c7f936b0-4be0-4a77-baeb-2b4998f6bf19 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:34:18.652824 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-c7f936b0-4be0-4a77-baeb-2b4998f6bf19 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:34:18.653465 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-c7f936b0-4be0-4a77-baeb-2b4998f6bf19 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:34:18.761840 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.objects.instance [None req-c7f936b0-4be0-4a77-baeb-2b4998f6bf19 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Lazy-loading 'services' on Instance uuid 83b29c39-45ca-4cb3-ad7d-f7bd47bfe667 {{(pid=117879) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 10:34:18.885117 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-c7f936b0-4be0-4a77-baeb-2b4998f6bf19 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] 10.222.0.33 "DELETE /compute/v2.1/servers/83b29c39-45ca-4cb3-ad7d-f7bd47bfe667/os-volume_attachments/9a55a428-fdbb-429d-8a61-e7c5f0c51092" status: 202 len: 0 microversion: 2.1 time: 0.246121 Jul 18 10:34:18.886198 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 356/706] 10.222.0.33 () {58 vars in 1415 bytes} [Mon Jul 18 10:34:18 2022] DELETE /compute/v2.1/servers/83b29c39-45ca-4cb3-ad7d-f7bd47bfe667/os-volume_attachments/9a55a428-fdbb-429d-8a61-e7c5f0c51092 => generated 0 bytes in 248 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 18 10:34:18.895496 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [req-8bef888a-15e7-4708-aa84-29e66710990d req-41f2ec79-de5b-4cd4-87d0-f39dfcec023a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "83b29c39-45ca-4cb3-ad7d-f7bd47bfe667", "tag": "8763c93e-265a-48e3-9444-a3c09c88377b"}]} {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:34:18.907251 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [req-8bef888a-15e7-4708-aa84-29e66710990d req-41f2ec79-de5b-4cd4-87d0-f39dfcec023a service nova] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:34:18.908641 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [req-8bef888a-15e7-4708-aa84-29e66710990d req-41f2ec79-de5b-4cd4-87d0-f39dfcec023a service nova] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:34:18.927310 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.compute.server_external_events [req-8bef888a-15e7-4708-aa84-29e66710990d req-41f2ec79-de5b-4cd4-87d0-f39dfcec023a service nova] Creating event network-changed:8763c93e-265a-48e3-9444-a3c09c88377b for instance 83b29c39-45ca-4cb3-ad7d-f7bd47bfe667 on hv-cinder-83754 Jul 18 10:34:18.951260 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.virt.hardware [None req-eebd8e3e-059f-4f94-9d32-fb6bf5b7ca94 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Flavor limits 0:0:0 {{(pid=117880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 10:34:18.952264 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.virt.hardware [None req-eebd8e3e-059f-4f94-9d32-fb6bf5b7ca94 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Image limits 0:0:0 {{(pid=117880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 10:34:18.953086 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.virt.hardware [None req-eebd8e3e-059f-4f94-9d32-fb6bf5b7ca94 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Flavor pref 0:0:0 {{(pid=117880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 10:34:18.954129 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.virt.hardware [None req-eebd8e3e-059f-4f94-9d32-fb6bf5b7ca94 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Image pref 0:0:0 {{(pid=117880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 10:34:18.954770 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.virt.hardware [None req-eebd8e3e-059f-4f94-9d32-fb6bf5b7ca94 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 10:34:18.956959 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [req-8bef888a-15e7-4708-aa84-29e66710990d req-41f2ec79-de5b-4cd4-87d0-f39dfcec023a service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068804 Jul 18 10:34:18.957816 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 357/707] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jul 18 10:34:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:34:18.968421 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-d4ded892-b5d7-4d3c-b56e-2050fd07224a tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:34:18.970654 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-d4ded892-b5d7-4d3c-b56e-2050fd07224a tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] [instance: 83b29c39-45ca-4cb3-ad7d-f7bd47bfe667] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:34:18.985263 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-d4ded892-b5d7-4d3c-b56e-2050fd07224a tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:34:18.986073 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-d4ded892-b5d7-4d3c-b56e-2050fd07224a tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:34:18.986517 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-eebd8e3e-059f-4f94-9d32-fb6bf5b7ca94 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:34:18.987138 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-eebd8e3e-059f-4f94-9d32-fb6bf5b7ca94 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:34:18.988348 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-eebd8e3e-059f-4f94-9d32-fb6bf5b7ca94 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:34:18.989072 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-eebd8e3e-059f-4f94-9d32-fb6bf5b7ca94 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:34:18.994610 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-d4ded892-b5d7-4d3c-b56e-2050fd07224a tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:34:18.995221 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-d4ded892-b5d7-4d3c-b56e-2050fd07224a tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:34:19.013870 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.quota [None req-eebd8e3e-059f-4f94-9d32-fb6bf5b7ca94 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Getting quotas for project feefb94984d54cbbaa70b963d956a520. Resources: {'ram', 'cores', 'instances'} {{(pid=117880) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 10:34:19.019154 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.quota [None req-eebd8e3e-059f-4f94-9d32-fb6bf5b7ca94 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Getting quotas for user cacc328f0f3540299310a0e53afe6acb and project feefb94984d54cbbaa70b963d956a520. Resources: {'ram', 'cores', 'instances'} {{(pid=117880) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 10:34:19.033659 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-eebd8e3e-059f-4f94-9d32-fb6bf5b7ca94 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Going to run 1 instances... {{(pid=117880) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 10:34:19.036583 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-eebd8e3e-059f-4f94-9d32-fb6bf5b7ca94 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] [instance: b1a84290-3520-427e-af49-f380d2a144bb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2cb02169-9999-411b-8c74-f88c068960fc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117880) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 10:34:19.072832 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-d4ded892-b5d7-4d3c-b56e-2050fd07224a tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] 10.222.0.33 "GET /compute/v2.1/servers/83b29c39-45ca-4cb3-ad7d-f7bd47bfe667/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.111745 Jul 18 10:34:19.073906 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 358/708] 10.222.0.33 () {58 vars in 1301 bytes} [Mon Jul 18 10:34:18 2022] GET /compute/v2.1/servers/83b29c39-45ca-4cb3-ad7d-f7bd47bfe667/os-volume_attachments => generated 197 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:34:19.111613 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-eebd8e3e-059f-4f94-9d32-fb6bf5b7ca94 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 1.163067 Jul 18 10:34:19.119959 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 351/709] 10.222.0.33 () {62 vars in 1187 bytes} [Mon Jul 18 10:34:17 2022] POST /compute/v2.1/servers => generated 401 bytes in 1174 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 18 10:34:19.122694 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-1b429dbd-5e91-427c-a654-b83e0ef92060 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:34:19.123307 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-1b429dbd-5e91-427c-a654-b83e0ef92060 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] [instance: b1a84290-3520-427e-af49-f380d2a144bb] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:34:19.520462 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-1b429dbd-5e91-427c-a654-b83e0ef92060 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:34:19.528477 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-1b429dbd-5e91-427c-a654-b83e0ef92060 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:34:19.533617 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-1b429dbd-5e91-427c-a654-b83e0ef92060 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:34:19.534764 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-1b429dbd-5e91-427c-a654-b83e0ef92060 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] 10.222.0.33 "GET /compute/v2.1/servers/b1a84290-3520-427e-af49-f380d2a144bb" status: 200 len: 1282 microversion: 2.20 time: 0.415939 Jul 18 10:34:19.539316 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 359/710] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jul 18 10:34:19 2022] GET /compute/v2.1/servers/b1a84290-3520-427e-af49-f380d2a144bb => generated 1282 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 10:34:19.911439 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-0bfb8e4e-b1f7-40ca-af27-b5f1a2fa3f66 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Action: 'create', calling method: .version_select at 0x7f9f49edc700>, body: {"keypair": {"name": "tempest-keypair-1648601324", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEkKj4jgXrnPHgxOHNCrBbm/3t76DZQWk2F/ZtxYKuFUBe73Alxn2Zq2wYHrMAWziT9htpAy/dAoHzvxSJaJ+OnGG4HQv4fCROF0ROf5PzFLboBZIeb0kEIBlwMXhwYlcg=="}} {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:34:19.931103 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.quota [None req-0bfb8e4e-b1f7-40ca-af27-b5f1a2fa3f66 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Getting quotas for project 1cf3d5bfe9a745f38372c42c9cfa1f63. Resources: {'key_pairs'} {{(pid=117880) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 10:34:19.935751 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.quota [None req-0bfb8e4e-b1f7-40ca-af27-b5f1a2fa3f66 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Getting quotas for user f25c72896a2d4d619e5ad4b5a0a79aa6 and project 1cf3d5bfe9a745f38372c42c9cfa1f63. Resources: {'key_pairs'} {{(pid=117880) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 10:34:19.962464 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-0bfb8e4e-b1f7-40ca-af27-b5f1a2fa3f66 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.057602 Jul 18 10:34:19.963769 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 352/711] 10.222.0.33 () {60 vars in 1158 bytes} [Mon Jul 18 10:34:19 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:34:20.090650 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-99a029cd-3349-4992-b7f6-e56238d1e6ce tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:34:20.093466 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-99a029cd-3349-4992-b7f6-e56238d1e6ce tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] [instance: 83b29c39-45ca-4cb3-ad7d-f7bd47bfe667] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:34:20.103092 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG dbcounter [-] [117879] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=3,nova_api:DELETE=2 {{(pid=117879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:34:20.104912 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-99a029cd-3349-4992-b7f6-e56238d1e6ce tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:34:20.105560 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-99a029cd-3349-4992-b7f6-e56238d1e6ce tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:34:20.106502 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-99a029cd-3349-4992-b7f6-e56238d1e6ce tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:34:20.107102 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-99a029cd-3349-4992-b7f6-e56238d1e6ce tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:34:20.198038 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-99a029cd-3349-4992-b7f6-e56238d1e6ce tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] 10.222.0.33 "GET /compute/v2.1/servers/83b29c39-45ca-4cb3-ad7d-f7bd47bfe667/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.115796 Jul 18 10:34:20.205707 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 360/712] 10.222.0.33 () {58 vars in 1301 bytes} [Mon Jul 18 10:34:20 2022] GET /compute/v2.1/servers/83b29c39-45ca-4cb3-ad7d-f7bd47bfe667/os-volume_attachments => generated 25 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 10:34:20.212463 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-291d050b-55e3-427e-8e47-7720a431764b tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:34:20.213808 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-291d050b-55e3-427e-8e47-7720a431764b tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] [instance: 83b29c39-45ca-4cb3-ad7d-f7bd47bfe667] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:34:20.224824 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-291d050b-55e3-427e-8e47-7720a431764b tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:34:20.226138 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-291d050b-55e3-427e-8e47-7720a431764b tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:34:20.228362 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-291d050b-55e3-427e-8e47-7720a431764b tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:34:20.228957 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-291d050b-55e3-427e-8e47-7720a431764b tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:34:20.330098 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.wsgi [None req-291d050b-55e3-427e-8e47-7720a431764b tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] HTTP exception thrown: Instance 83b29c39-45ca-4cb3-ad7d-f7bd47bfe667 is not attached to volume 9a55a428-fdbb-429d-8a61-e7c5f0c51092 Jul 18 10:34:20.332499 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-291d050b-55e3-427e-8e47-7720a431764b tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Request method failure captured: Jul 18 10:34:20.332499 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: request: DELETE /compute/v2.1/servers/83b29c39-45ca-4cb3-ad7d-f7bd47bfe667/os-volume_attachments/9a55a428-fdbb-429d-8a61-e7c5f0c51092 HTTP/1.1 Jul 18 10:34:20.332499 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: Accept: application/json Jul 18 10:34:20.332499 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: Accept-Encoding: identity Jul 18 10:34:20.332499 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: Connection: close Jul 18 10:34:20.332499 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: Content-Length: 0 Jul 18 10:34:20.332499 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: Content-Type: application/json Jul 18 10:34:20.332499 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: Host: 10.222.0.33 Jul 18 10:34:20.332499 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: Openstack-System-Scope: None Jul 18 10:34:20.332499 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: User-Agent: python-urllib3/1.26.9 Jul 18 10:34:20.332499 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Auth-Token: gAAAAABi1TaEKZClPt7ETKo1rE8jbPI4NcaONtlLtwv2OqIGl6ucqLhZnhxcMsredR9BDjXp6ia7Hs6Bydfo2PtISvt_RreoeOOPsn7CuttYt9pstnCWI29lHHMRwRHFZYdx5EzFr1JREi1FmIimNbC4uILQAd_b2zyoB-6mk4KheI1QLeXOdEA Jul 18 10:34:20.332499 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Domain-Id: None Jul 18 10:34:20.332499 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Domain-Name: None Jul 18 10:34:20.332499 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Identity-Status: Confirmed Jul 18 10:34:20.332499 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Is-Admin-Project: True Jul 18 10:34:20.332499 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Project-Domain-Id: default Jul 18 10:34:20.332499 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Project-Domain-Name: Default Jul 18 10:34:20.332499 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Project-Id: f62ef510c8484995a2f31f29104f399f Jul 18 10:34:20.332499 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Project-Name: tempest-TestMinimumBasicScenario-1469591209 Jul 18 10:34:20.332499 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Role: member,reader Jul 18 10:34:20.332499 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Roles: member,reader Jul 18 10:34:20.333885 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f62ef510c8484995a2f31f29104f399f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f62ef510c8484995a2f31f29104f399f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/f62ef510c8484995a2f31f29104f399f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_f62ef510c8484995a2f31f29104f399f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jul 18 10:34:20.333885 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Tenant: tempest-TestMinimumBasicScenario-1469591209 Jul 18 10:34:20.333885 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Tenant-Id: f62ef510c8484995a2f31f29104f399f Jul 18 10:34:20.333885 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1469591209 Jul 18 10:34:20.333885 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-User: tempest-TestMinimumBasicScenario-1469591209-project Jul 18 10:34:20.333885 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-User-Domain-Id: default Jul 18 10:34:20.333885 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-User-Domain-Name: Default Jul 18 10:34:20.333885 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-User-Id: 1af30265de71409d876112350949a2a4 Jul 18 10:34:20.333885 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-User-Name: tempest-TestMinimumBasicScenario-1469591209-project Jul 18 10:34:20.333885 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: method: > Jul 18 10:34:20.333885 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: exception: Instance 83b29c39-45ca-4cb3-ad7d-f7bd47bfe667 is not attached to volume 9a55a428-fdbb-429d-8a61-e7c5f0c51092 Jul 18 10:34:20.334598 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: action_args: {'server_id': '83b29c39-45ca-4cb3-ad7d-f7bd47bfe667', 'id': '9a55a428-fdbb-429d-8a61-e7c5f0c51092'} Jul 18 10:34:20.334598 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 10:34:20.334598 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:34:20.334598 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jul 18 10:34:20.334598 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jul 18 10:34:20.334598 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 18 10:34:20.334598 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 18 10:34:20.334598 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jul 18 10:34:20.334598 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jul 18 10:34:20.334598 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 9a55a428-fdbb-429d-8a61-e7c5f0c51092. Jul 18 10:34:20.334598 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi Jul 18 10:34:20.334598 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:34:20.334598 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi Jul 18 10:34:20.334598 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:34:20.334598 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:34:20.334598 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:34:20.334598 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 10:34:20.334598 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 10:34:20.334598 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 10:34:20.336165 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 10:34:20.336165 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jul 18 10:34:20.336165 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 18 10:34:20.336165 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 83b29c39-45ca-4cb3-ad7d-f7bd47bfe667 is not attached to volume 9a55a428-fdbb-429d-8a61-e7c5f0c51092 Jul 18 10:34:20.336165 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi Jul 18 10:34:20.336165 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:34:20.336165 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi Jul 18 10:34:20.336165 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:34:20.336165 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:34:20.336165 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:34:20.336165 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 10:34:20.336165 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 10:34:20.336165 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 83b29c39-45ca-4cb3-ad7d-f7bd47bfe667 is not attached to volume 9a55a428-fdbb-429d-8a61-e7c5f0c51092 Jul 18 10:34:20.336165 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi Jul 18 10:34:20.336165 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-291d050b-55e3-427e-8e47-7720a431764b tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Returning 404 to user: Instance 83b29c39-45ca-4cb3-ad7d-f7bd47bfe667 is not attached to volume 9a55a428-fdbb-429d-8a61-e7c5f0c51092 {{(pid=117880) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 10:34:20.337368 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-291d050b-55e3-427e-8e47-7720a431764b tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] 10.222.0.33 "DELETE /compute/v2.1/servers/83b29c39-45ca-4cb3-ad7d-f7bd47bfe667/os-volume_attachments/9a55a428-fdbb-429d-8a61-e7c5f0c51092" status: 404 len: 154 microversion: 2.1 time: 0.126685 Jul 18 10:34:20.338306 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 353/713] 10.222.0.33 () {58 vars in 1415 bytes} [Mon Jul 18 10:34:20 2022] DELETE /compute/v2.1/servers/83b29c39-45ca-4cb3-ad7d-f7bd47bfe667/os-volume_attachments/9a55a428-fdbb-429d-8a61-e7c5f0c51092 => generated 154 bytes in 132 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 10:34:20.555824 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-d0e7a7f4-0995-4a07-8295-39c9f0532fba tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:34:20.556437 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-d0e7a7f4-0995-4a07-8295-39c9f0532fba tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] [instance: b1a84290-3520-427e-af49-f380d2a144bb] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:34:20.575984 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-d0e7a7f4-0995-4a07-8295-39c9f0532fba tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:34:20.576635 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-d0e7a7f4-0995-4a07-8295-39c9f0532fba tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:34:20.577457 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-d0e7a7f4-0995-4a07-8295-39c9f0532fba tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:34:20.577904 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-d0e7a7f4-0995-4a07-8295-39c9f0532fba tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:34:20.748171 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-d0e7a7f4-0995-4a07-8295-39c9f0532fba tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:34:20.766883 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-d0e7a7f4-0995-4a07-8295-39c9f0532fba tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:34:20.770632 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-d0e7a7f4-0995-4a07-8295-39c9f0532fba tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:34:20.776042 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-d0e7a7f4-0995-4a07-8295-39c9f0532fba tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] 10.222.0.33 "GET /compute/v2.1/servers/b1a84290-3520-427e-af49-f380d2a144bb" status: 200 len: 1342 microversion: 2.20 time: 0.224346 Jul 18 10:34:20.777089 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 361/714] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jul 18 10:34:20 2022] GET /compute/v2.1/servers/b1a84290-3520-427e-af49-f380d2a144bb => generated 1342 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:34:21.513293 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-092172e3-6d8a-493b-9145-f2b511e26330 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:34:21.513293 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-092172e3-6d8a-493b-9145-f2b511e26330 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] [instance: 83b29c39-45ca-4cb3-ad7d-f7bd47bfe667] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:34:21.515682 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG dbcounter [-] [117880] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=3,nova_api:INSERT=5 {{(pid=117880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:34:21.526705 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-092172e3-6d8a-493b-9145-f2b511e26330 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:34:21.527154 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-092172e3-6d8a-493b-9145-f2b511e26330 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:34:21.527922 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-092172e3-6d8a-493b-9145-f2b511e26330 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:34:21.528550 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-092172e3-6d8a-493b-9145-f2b511e26330 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:34:21.557905 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-092172e3-6d8a-493b-9145-f2b511e26330 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] [instance: 83b29c39-45ca-4cb3-ad7d-f7bd47bfe667] Going to try to terminate instance {{(pid=117880) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 10:34:21.677010 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-092172e3-6d8a-493b-9145-f2b511e26330 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] 10.222.0.33 "DELETE /compute/v2.1/servers/83b29c39-45ca-4cb3-ad7d-f7bd47bfe667" status: 204 len: 0 microversion: 2.1 time: 0.167787 Jul 18 10:34:21.677723 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 354/715] 10.222.0.33 () {58 vars in 1238 bytes} [Mon Jul 18 10:34:21 2022] DELETE /compute/v2.1/servers/83b29c39-45ca-4cb3-ad7d-f7bd47bfe667 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 10:34:21.686041 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-3635374b-ed10-48e7-8693-f1824975aabd tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:34:21.686916 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-3635374b-ed10-48e7-8693-f1824975aabd tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] [instance: 83b29c39-45ca-4cb3-ad7d-f7bd47bfe667] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:34:21.694255 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-3635374b-ed10-48e7-8693-f1824975aabd tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:34:21.694874 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-3635374b-ed10-48e7-8693-f1824975aabd tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:34:21.695714 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-3635374b-ed10-48e7-8693-f1824975aabd tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:34:21.697256 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-3635374b-ed10-48e7-8693-f1824975aabd tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:34:21.757442 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-1a7b8d8a-1706-41cf-9167-c06a668a3bca tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1212672147", "imageRef": "2cb02169-9999-411b-8c74-f88c068960fc", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a8d66173-a1e2-46af-a5dc-6e62a2d0a4e4"}], "security_groups": [{"name": "tempest-securitygroup--1265559755"}], "key_name": "tempest-keypair-1648601324", "user_data": "}} {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:34:21.986902 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.network.neutron [None req-1a7b8d8a-1706-41cf-9167-c06a668a3bca tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] validate_networks() for [('a8d66173-a1e2-46af-a5dc-6e62a2d0a4e4', None, None, None, None, None)] {{(pid=117880) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 10:34:22.021481 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-3635374b-ed10-48e7-8693-f1824975aabd tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af30265de71409d876112350949a2a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f62ef510c8484995a2f31f29104f399f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:34:22.028981 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-3635374b-ed10-48e7-8693-f1824975aabd tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] 10.222.0.33 "GET /compute/v2.1/servers/83b29c39-45ca-4cb3-ad7d-f7bd47bfe667" status: 200 len: 1555 microversion: 2.1 time: 0.346651 Jul 18 10:34:22.029679 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 362/716] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:34:21 2022] GET /compute/v2.1/servers/83b29c39-45ca-4cb3-ad7d-f7bd47bfe667 => generated 1555 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:34:22.042478 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-89f99e33-85cd-4119-bc1c-f571dce36834 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:34:22.043132 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-89f99e33-85cd-4119-bc1c-f571dce36834 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] [instance: b1a84290-3520-427e-af49-f380d2a144bb] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:34:22.049806 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-89f99e33-85cd-4119-bc1c-f571dce36834 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:34:22.050264 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-89f99e33-85cd-4119-bc1c-f571dce36834 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:34:22.051049 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-89f99e33-85cd-4119-bc1c-f571dce36834 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:34:22.051492 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-89f99e33-85cd-4119-bc1c-f571dce36834 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:34:22.352308 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-89f99e33-85cd-4119-bc1c-f571dce36834 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:34:22.361365 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-89f99e33-85cd-4119-bc1c-f571dce36834 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:34:22.363296 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-89f99e33-85cd-4119-bc1c-f571dce36834 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:34:22.364598 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-89f99e33-85cd-4119-bc1c-f571dce36834 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] 10.222.0.33 "GET /compute/v2.1/servers/b1a84290-3520-427e-af49-f380d2a144bb" status: 200 len: 1407 microversion: 2.20 time: 0.333648 Jul 18 10:34:22.365301 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 363/717] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jul 18 10:34:22 2022] GET /compute/v2.1/servers/b1a84290-3520-427e-af49-f380d2a144bb => generated 1407 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:34:22.709762 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.virt.hardware [None req-1a7b8d8a-1706-41cf-9167-c06a668a3bca tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Flavor limits 0:0:0 {{(pid=117880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 10:34:22.710253 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.virt.hardware [None req-1a7b8d8a-1706-41cf-9167-c06a668a3bca tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Image limits 0:0:0 {{(pid=117880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 10:34:22.710643 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.virt.hardware [None req-1a7b8d8a-1706-41cf-9167-c06a668a3bca tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Flavor pref 0:0:0 {{(pid=117880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 10:34:22.711131 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.virt.hardware [None req-1a7b8d8a-1706-41cf-9167-c06a668a3bca tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Image pref 0:0:0 {{(pid=117880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 10:34:22.711541 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.virt.hardware [None req-1a7b8d8a-1706-41cf-9167-c06a668a3bca tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 10:34:22.721562 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-1a7b8d8a-1706-41cf-9167-c06a668a3bca tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:34:22.722004 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-1a7b8d8a-1706-41cf-9167-c06a668a3bca tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:34:22.722796 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-1a7b8d8a-1706-41cf-9167-c06a668a3bca tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:34:22.723223 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-1a7b8d8a-1706-41cf-9167-c06a668a3bca tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:34:22.741865 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.quota [None req-1a7b8d8a-1706-41cf-9167-c06a668a3bca tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Getting quotas for project 1cf3d5bfe9a745f38372c42c9cfa1f63. Resources: {'ram', 'cores', 'instances'} {{(pid=117880) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 10:34:22.745726 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.quota [None req-1a7b8d8a-1706-41cf-9167-c06a668a3bca tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Getting quotas for user f25c72896a2d4d619e5ad4b5a0a79aa6 and project 1cf3d5bfe9a745f38372c42c9cfa1f63. Resources: {'ram', 'cores', 'instances'} {{(pid=117880) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 10:34:22.758064 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-1a7b8d8a-1706-41cf-9167-c06a668a3bca tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Going to run 1 instances... {{(pid=117880) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 10:34:22.760591 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-1a7b8d8a-1706-41cf-9167-c06a668a3bca tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] [instance: 72245495-f5b8-4f54-8d17-ec3e700bdd9b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2cb02169-9999-411b-8c74-f88c068960fc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117880) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 10:34:22.769859 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [req-6e798dd2-9536-4668-8681-d153a06bbb50 req-87a581b7-0a08-417a-bc10-8e052d54640f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b1a84290-3520-427e-af49-f380d2a144bb", "tag": "b5aa065e-e228-4681-909e-bd39389938fd"}]} {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:34:22.779312 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [req-6e798dd2-9536-4668-8681-d153a06bbb50 req-87a581b7-0a08-417a-bc10-8e052d54640f service nova] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:34:22.779792 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [req-6e798dd2-9536-4668-8681-d153a06bbb50 req-87a581b7-0a08-417a-bc10-8e052d54640f service nova] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:34:22.804910 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.compute.server_external_events [req-6e798dd2-9536-4668-8681-d153a06bbb50 req-87a581b7-0a08-417a-bc10-8e052d54640f service nova] Creating event network-changed:b5aa065e-e228-4681-909e-bd39389938fd for instance b1a84290-3520-427e-af49-f380d2a144bb on hv-cinder-83754 Jul 18 10:34:22.810114 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [req-6e798dd2-9536-4668-8681-d153a06bbb50 req-87a581b7-0a08-417a-bc10-8e052d54640f service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043530 Jul 18 10:34:22.811048 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 364/718] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jul 18 10:34:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 10:34:22.813301 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-1a7b8d8a-1706-41cf-9167-c06a668a3bca tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.060271 Jul 18 10:34:22.818898 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 355/719] 10.222.0.33 () {60 vars in 1146 bytes} [Mon Jul 18 10:34:21 2022] POST /compute/v2.1/servers => generated 402 bytes in 1063 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 18 10:34:22.824376 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-5c5c015f-ef7f-4795-b65b-77d5e09aa0db tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:34:22.825120 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-5c5c015f-ef7f-4795-b65b-77d5e09aa0db tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] [instance: 72245495-f5b8-4f54-8d17-ec3e700bdd9b] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:34:22.882970 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-5c5c015f-ef7f-4795-b65b-77d5e09aa0db tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f25c72896a2d4d619e5ad4b5a0a79aa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cf3d5bfe9a745f38372c42c9cfa1f63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:34:22.889884 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-5c5c015f-ef7f-4795-b65b-77d5e09aa0db tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] 10.222.0.33 "GET /compute/v2.1/servers/72245495-f5b8-4f54-8d17-ec3e700bdd9b" status: 200 len: 1242 microversion: 2.1 time: 0.069636 Jul 18 10:34:22.890508 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 365/720] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:34:22 2022] GET /compute/v2.1/servers/72245495-f5b8-4f54-8d17-ec3e700bdd9b => generated 1242 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:34:23.047057 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-0440dc4e-0708-4bc2-8ab6-eedac414152d tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:34:23.047666 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-0440dc4e-0708-4bc2-8ab6-eedac414152d tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] [instance: 83b29c39-45ca-4cb3-ad7d-f7bd47bfe667] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:34:23.053710 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-0440dc4e-0708-4bc2-8ab6-eedac414152d tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:34:23.054153 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-0440dc4e-0708-4bc2-8ab6-eedac414152d tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:34:23.054903 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-0440dc4e-0708-4bc2-8ab6-eedac414152d tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:34:23.055331 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-0440dc4e-0708-4bc2-8ab6-eedac414152d tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:34:23.195059 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-0440dc4e-0708-4bc2-8ab6-eedac414152d tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af30265de71409d876112350949a2a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f62ef510c8484995a2f31f29104f399f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:34:23.204525 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-0440dc4e-0708-4bc2-8ab6-eedac414152d tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] 10.222.0.33 "GET /compute/v2.1/servers/83b29c39-45ca-4cb3-ad7d-f7bd47bfe667" status: 200 len: 1555 microversion: 2.1 time: 0.161234 Jul 18 10:34:23.214836 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 356/721] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:34:23 2022] GET /compute/v2.1/servers/83b29c39-45ca-4cb3-ad7d-f7bd47bfe667 => generated 1555 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:34:23.384144 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-8cf92229-4406-4f66-b1f6-f243175ce902 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:34:23.384919 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-8cf92229-4406-4f66-b1f6-f243175ce902 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] [instance: b1a84290-3520-427e-af49-f380d2a144bb] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:34:23.392024 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-8cf92229-4406-4f66-b1f6-f243175ce902 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:34:23.392822 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-8cf92229-4406-4f66-b1f6-f243175ce902 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:34:23.393811 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-8cf92229-4406-4f66-b1f6-f243175ce902 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:34:23.394321 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-8cf92229-4406-4f66-b1f6-f243175ce902 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:34:23.597268 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-8cf92229-4406-4f66-b1f6-f243175ce902 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:34:23.606087 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-8cf92229-4406-4f66-b1f6-f243175ce902 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:34:23.608310 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-8cf92229-4406-4f66-b1f6-f243175ce902 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:34:23.609447 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-8cf92229-4406-4f66-b1f6-f243175ce902 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] 10.222.0.33 "GET /compute/v2.1/servers/b1a84290-3520-427e-af49-f380d2a144bb" status: 200 len: 1407 microversion: 2.20 time: 0.229324 Jul 18 10:34:23.610009 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 366/722] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jul 18 10:34:23 2022] GET /compute/v2.1/servers/b1a84290-3520-427e-af49-f380d2a144bb => generated 1407 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:34:23.914906 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-adfa7265-d7f7-4206-84ec-455372806aea tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:34:23.915795 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-adfa7265-d7f7-4206-84ec-455372806aea tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] [instance: 72245495-f5b8-4f54-8d17-ec3e700bdd9b] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:34:23.923448 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-adfa7265-d7f7-4206-84ec-455372806aea tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:34:23.924185 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-adfa7265-d7f7-4206-84ec-455372806aea tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:34:23.925001 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-adfa7265-d7f7-4206-84ec-455372806aea tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:34:23.925466 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-adfa7265-d7f7-4206-84ec-455372806aea tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:34:24.065289 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-adfa7265-d7f7-4206-84ec-455372806aea tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f25c72896a2d4d619e5ad4b5a0a79aa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cf3d5bfe9a745f38372c42c9cfa1f63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:34:24.073428 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-adfa7265-d7f7-4206-84ec-455372806aea tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] 10.222.0.33 "GET /compute/v2.1/servers/72245495-f5b8-4f54-8d17-ec3e700bdd9b" status: 200 len: 1302 microversion: 2.1 time: 0.162354 Jul 18 10:34:24.074272 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 357/723] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:34:23 2022] GET /compute/v2.1/servers/72245495-f5b8-4f54-8d17-ec3e700bdd9b => generated 1302 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:34:24.222423 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-d43b60be-3b0f-4a83-8414-92c22c827b4f tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:34:24.223046 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-d43b60be-3b0f-4a83-8414-92c22c827b4f tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] [instance: 83b29c39-45ca-4cb3-ad7d-f7bd47bfe667] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:34:24.229748 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-d43b60be-3b0f-4a83-8414-92c22c827b4f tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:34:24.230204 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-d43b60be-3b0f-4a83-8414-92c22c827b4f tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:34:24.230968 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-d43b60be-3b0f-4a83-8414-92c22c827b4f tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:34:24.231406 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-d43b60be-3b0f-4a83-8414-92c22c827b4f tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:34:24.238048 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG dbcounter [-] [117879] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=2 {{(pid=117879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:34:24.628057 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-d43b60be-3b0f-4a83-8414-92c22c827b4f tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af30265de71409d876112350949a2a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f62ef510c8484995a2f31f29104f399f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:34:24.628226 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-6c04fb6b-4db9-4891-be81-74afac134fd0 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:34:24.628971 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-6c04fb6b-4db9-4891-be81-74afac134fd0 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] [instance: b1a84290-3520-427e-af49-f380d2a144bb] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:34:24.635199 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-6c04fb6b-4db9-4891-be81-74afac134fd0 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:34:24.635742 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-6c04fb6b-4db9-4891-be81-74afac134fd0 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:34:24.636547 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-d43b60be-3b0f-4a83-8414-92c22c827b4f tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] 10.222.0.33 "GET /compute/v2.1/servers/83b29c39-45ca-4cb3-ad7d-f7bd47bfe667" status: 200 len: 1555 microversion: 2.1 time: 0.418512 Jul 18 10:34:24.636684 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-6c04fb6b-4db9-4891-be81-74afac134fd0 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:34:24.637123 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 367/724] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:34:24 2022] GET /compute/v2.1/servers/83b29c39-45ca-4cb3-ad7d-f7bd47bfe667 => generated 1555 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:34:24.646079 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-6c04fb6b-4db9-4891-be81-74afac134fd0 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:34:24.646079 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG dbcounter [-] [117880] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:34:25.006628 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-6c04fb6b-4db9-4891-be81-74afac134fd0 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:34:25.014619 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-6c04fb6b-4db9-4891-be81-74afac134fd0 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:34:25.016117 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-6c04fb6b-4db9-4891-be81-74afac134fd0 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:34:25.017344 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-6c04fb6b-4db9-4891-be81-74afac134fd0 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] 10.222.0.33 "GET /compute/v2.1/servers/b1a84290-3520-427e-af49-f380d2a144bb" status: 200 len: 1407 microversion: 2.20 time: 0.393894 Jul 18 10:34:25.027394 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 358/725] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jul 18 10:34:24 2022] GET /compute/v2.1/servers/b1a84290-3520-427e-af49-f380d2a144bb => generated 1407 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 10:34:25.090863 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-88c9005c-e1ad-4468-a0d9-045767912c19 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:34:25.091581 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-88c9005c-e1ad-4468-a0d9-045767912c19 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] [instance: 72245495-f5b8-4f54-8d17-ec3e700bdd9b] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:34:25.098610 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-88c9005c-e1ad-4468-a0d9-045767912c19 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:34:25.099129 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-88c9005c-e1ad-4468-a0d9-045767912c19 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:34:25.099918 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-88c9005c-e1ad-4468-a0d9-045767912c19 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:34:25.100357 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-88c9005c-e1ad-4468-a0d9-045767912c19 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:34:25.373729 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [req-d1b0bfb4-75fa-408f-a7c3-7bfafc0f03ff req-db08e3e7-3a05-4226-8cc7-0af48ddde26f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "83b29c39-45ca-4cb3-ad7d-f7bd47bfe667", "name": "network-vif-deleted", "tag": "8763c93e-265a-48e3-9444-a3c09c88377b"}]} {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:34:25.377662 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-88c9005c-e1ad-4468-a0d9-045767912c19 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f25c72896a2d4d619e5ad4b5a0a79aa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cf3d5bfe9a745f38372c42c9cfa1f63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:34:25.383400 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [req-d1b0bfb4-75fa-408f-a7c3-7bfafc0f03ff req-db08e3e7-3a05-4226-8cc7-0af48ddde26f service nova] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:34:25.383934 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [req-d1b0bfb4-75fa-408f-a7c3-7bfafc0f03ff req-db08e3e7-3a05-4226-8cc7-0af48ddde26f service nova] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:34:25.392954 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-88c9005c-e1ad-4468-a0d9-045767912c19 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] 10.222.0.33 "GET /compute/v2.1/servers/72245495-f5b8-4f54-8d17-ec3e700bdd9b" status: 200 len: 1300 microversion: 2.1 time: 0.305943 Jul 18 10:34:25.393861 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 368/726] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:34:25 2022] GET /compute/v2.1/servers/72245495-f5b8-4f54-8d17-ec3e700bdd9b => generated 1300 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:34:25.396232 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.compute.server_external_events [req-d1b0bfb4-75fa-408f-a7c3-7bfafc0f03ff req-db08e3e7-3a05-4226-8cc7-0af48ddde26f service nova] Creating event network-vif-deleted:8763c93e-265a-48e3-9444-a3c09c88377b for instance 83b29c39-45ca-4cb3-ad7d-f7bd47bfe667 on hv-cinder-83754 Jul 18 10:34:25.401118 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [req-d1b0bfb4-75fa-408f-a7c3-7bfafc0f03ff req-db08e3e7-3a05-4226-8cc7-0af48ddde26f service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031187 Jul 18 10:34:25.401995 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 359/727] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jul 18 10:34:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 10:34:25.653321 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-f38dad6a-7ed0-4538-95a2-181a959cdc01 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:34:25.653933 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-f38dad6a-7ed0-4538-95a2-181a959cdc01 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] [instance: 83b29c39-45ca-4cb3-ad7d-f7bd47bfe667] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:34:25.665420 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-f38dad6a-7ed0-4538-95a2-181a959cdc01 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:34:25.665878 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-f38dad6a-7ed0-4538-95a2-181a959cdc01 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:34:25.666652 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-f38dad6a-7ed0-4538-95a2-181a959cdc01 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:34:25.667155 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-f38dad6a-7ed0-4538-95a2-181a959cdc01 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:34:25.740555 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-f38dad6a-7ed0-4538-95a2-181a959cdc01 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af30265de71409d876112350949a2a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f62ef510c8484995a2f31f29104f399f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:34:25.748052 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-f38dad6a-7ed0-4538-95a2-181a959cdc01 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] 10.222.0.33 "GET /compute/v2.1/servers/83b29c39-45ca-4cb3-ad7d-f7bd47bfe667" status: 200 len: 1513 microversion: 2.1 time: 0.098577 Jul 18 10:34:25.757522 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 369/728] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:34:25 2022] GET /compute/v2.1/servers/83b29c39-45ca-4cb3-ad7d-f7bd47bfe667 => generated 1513 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:34:26.038981 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-0e66b420-5abb-4eba-b718-6efefcb4b359 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:34:26.039681 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-0e66b420-5abb-4eba-b718-6efefcb4b359 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] [instance: b1a84290-3520-427e-af49-f380d2a144bb] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:34:26.045812 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-0e66b420-5abb-4eba-b718-6efefcb4b359 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:34:26.046512 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-0e66b420-5abb-4eba-b718-6efefcb4b359 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:34:26.048354 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-0e66b420-5abb-4eba-b718-6efefcb4b359 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:34:26.048354 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-0e66b420-5abb-4eba-b718-6efefcb4b359 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:34:26.280540 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-0e66b420-5abb-4eba-b718-6efefcb4b359 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:34:26.291002 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-0e66b420-5abb-4eba-b718-6efefcb4b359 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:34:26.292441 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-0e66b420-5abb-4eba-b718-6efefcb4b359 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:34:26.294151 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-0e66b420-5abb-4eba-b718-6efefcb4b359 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] 10.222.0.33 "GET /compute/v2.1/servers/b1a84290-3520-427e-af49-f380d2a144bb" status: 200 len: 1407 microversion: 2.20 time: 0.262719 Jul 18 10:34:26.294836 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 360/729] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jul 18 10:34:26 2022] GET /compute/v2.1/servers/b1a84290-3520-427e-af49-f380d2a144bb => generated 1407 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:34:26.411032 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-83c0e7a5-4c9f-4c40-80be-66be558213ed tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:34:26.412085 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-83c0e7a5-4c9f-4c40-80be-66be558213ed tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] [instance: 72245495-f5b8-4f54-8d17-ec3e700bdd9b] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:34:26.419202 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-83c0e7a5-4c9f-4c40-80be-66be558213ed tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:34:26.420100 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-83c0e7a5-4c9f-4c40-80be-66be558213ed tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:34:26.421395 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-83c0e7a5-4c9f-4c40-80be-66be558213ed tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:34:26.422835 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-83c0e7a5-4c9f-4c40-80be-66be558213ed tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:34:26.626355 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-83c0e7a5-4c9f-4c40-80be-66be558213ed tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f25c72896a2d4d619e5ad4b5a0a79aa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cf3d5bfe9a745f38372c42c9cfa1f63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:34:26.633924 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-83c0e7a5-4c9f-4c40-80be-66be558213ed tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] 10.222.0.33 "GET /compute/v2.1/servers/72245495-f5b8-4f54-8d17-ec3e700bdd9b" status: 200 len: 1368 microversion: 2.1 time: 0.226911 Jul 18 10:34:26.634872 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 370/730] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:34:26 2022] GET /compute/v2.1/servers/72245495-f5b8-4f54-8d17-ec3e700bdd9b => generated 1368 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:34:26.765988 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-67090371-6d86-4be8-bf2f-e6f02298ac3c tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:34:26.766816 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-67090371-6d86-4be8-bf2f-e6f02298ac3c tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] [instance: 83b29c39-45ca-4cb3-ad7d-f7bd47bfe667] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:34:26.773429 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-67090371-6d86-4be8-bf2f-e6f02298ac3c tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:34:26.773892 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-67090371-6d86-4be8-bf2f-e6f02298ac3c tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:34:26.774665 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-67090371-6d86-4be8-bf2f-e6f02298ac3c tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:34:26.775275 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-67090371-6d86-4be8-bf2f-e6f02298ac3c tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:34:26.790744 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.wsgi [None req-67090371-6d86-4be8-bf2f-e6f02298ac3c tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] HTTP exception thrown: Instance 83b29c39-45ca-4cb3-ad7d-f7bd47bfe667 could not be found. Jul 18 10:34:26.792393 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-67090371-6d86-4be8-bf2f-e6f02298ac3c tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Request method failure captured: Jul 18 10:34:26.792393 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: request: GET /compute/v2.1/servers/83b29c39-45ca-4cb3-ad7d-f7bd47bfe667 HTTP/1.1 Jul 18 10:34:26.792393 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: Accept: application/json Jul 18 10:34:26.792393 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: Accept-Encoding: identity Jul 18 10:34:26.792393 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: Connection: close Jul 18 10:34:26.792393 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: Content-Length: 0 Jul 18 10:34:26.792393 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: Content-Type: application/json Jul 18 10:34:26.792393 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: Host: 10.222.0.33 Jul 18 10:34:26.792393 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: Openstack-System-Scope: None Jul 18 10:34:26.792393 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: User-Agent: python-urllib3/1.26.9 Jul 18 10:34:26.792393 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Auth-Token: gAAAAABi1TaEKZClPt7ETKo1rE8jbPI4NcaONtlLtwv2OqIGl6ucqLhZnhxcMsredR9BDjXp6ia7Hs6Bydfo2PtISvt_RreoeOOPsn7CuttYt9pstnCWI29lHHMRwRHFZYdx5EzFr1JREi1FmIimNbC4uILQAd_b2zyoB-6mk4KheI1QLeXOdEA Jul 18 10:34:26.792393 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Domain-Id: None Jul 18 10:34:26.792393 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Domain-Name: None Jul 18 10:34:26.792393 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Identity-Status: Confirmed Jul 18 10:34:26.792393 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Is-Admin-Project: True Jul 18 10:34:26.792393 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Project-Domain-Id: default Jul 18 10:34:26.792393 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Project-Domain-Name: Default Jul 18 10:34:26.792393 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Project-Id: f62ef510c8484995a2f31f29104f399f Jul 18 10:34:26.792393 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Project-Name: tempest-TestMinimumBasicScenario-1469591209 Jul 18 10:34:26.792393 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Role: member,reader Jul 18 10:34:26.792393 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Roles: member,reader Jul 18 10:34:26.794155 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f62ef510c8484995a2f31f29104f399f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f62ef510c8484995a2f31f29104f399f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/f62ef510c8484995a2f31f29104f399f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_f62ef510c8484995a2f31f29104f399f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jul 18 10:34:26.794155 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Tenant: tempest-TestMinimumBasicScenario-1469591209 Jul 18 10:34:26.794155 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Tenant-Id: f62ef510c8484995a2f31f29104f399f Jul 18 10:34:26.794155 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1469591209 Jul 18 10:34:26.794155 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-User: tempest-TestMinimumBasicScenario-1469591209-project Jul 18 10:34:26.794155 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-User-Domain-Id: default Jul 18 10:34:26.794155 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-User-Domain-Name: Default Jul 18 10:34:26.794155 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-User-Id: 1af30265de71409d876112350949a2a4 Jul 18 10:34:26.794155 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-User-Name: tempest-TestMinimumBasicScenario-1469591209-project Jul 18 10:34:26.794155 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: method: > Jul 18 10:34:26.794155 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: exception: Instance 83b29c39-45ca-4cb3-ad7d-f7bd47bfe667 could not be found. Jul 18 10:34:26.794155 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: action_args: {'id': '83b29c39-45ca-4cb3-ad7d-f7bd47bfe667'} Jul 18 10:34:26.795106 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 10:34:26.795106 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:34:26.795106 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 10:34:26.795106 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 10:34:26.795106 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 10:34:26.795106 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 10:34:26.795106 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 10:34:26.795106 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 10:34:26.795106 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 10:34:26.795106 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 10:34:26.795106 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 83b29c39-45ca-4cb3-ad7d-f7bd47bfe667 could not be found. Jul 18 10:34:26.795106 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi Jul 18 10:34:26.795106 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:34:26.795106 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi Jul 18 10:34:26.795106 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:34:26.795106 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:34:26.795106 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:34:26.795106 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 10:34:26.795106 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 10:34:26.795106 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 10:34:26.796616 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 10:34:26.796616 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 10:34:26.796616 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 10:34:26.796616 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 10:34:26.796616 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 10:34:26.796616 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 10:34:26.796616 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 10:34:26.796616 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 83b29c39-45ca-4cb3-ad7d-f7bd47bfe667 could not be found. Jul 18 10:34:26.796616 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi Jul 18 10:34:26.796616 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:34:26.796616 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi Jul 18 10:34:26.796616 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:34:26.796616 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:34:26.796616 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:34:26.796616 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 10:34:26.796616 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 10:34:26.796616 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 83b29c39-45ca-4cb3-ad7d-f7bd47bfe667 could not be found. Jul 18 10:34:26.796616 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi Jul 18 10:34:26.797967 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-67090371-6d86-4be8-bf2f-e6f02298ac3c tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Returning 404 to user: Instance 83b29c39-45ca-4cb3-ad7d-f7bd47bfe667 could not be found. {{(pid=117880) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 10:34:26.797967 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-67090371-6d86-4be8-bf2f-e6f02298ac3c tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] 10.222.0.33 "GET /compute/v2.1/servers/83b29c39-45ca-4cb3-ad7d-f7bd47bfe667" status: 404 len: 111 microversion: 2.1 time: 0.032554 Jul 18 10:34:26.803331 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-9b73105d-ffc9-4a53-808d-c4eaa66e4031 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] Calling method '.version_select at 0x7f9f4a03c1f0>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:34:26.807331 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 361/731] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:34:26 2022] GET /compute/v2.1/servers/83b29c39-45ca-4cb3-ad7d-f7bd47bfe667 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 10:34:26.823902 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-9b73105d-ffc9-4a53-808d-c4eaa66e4031 tempest-TestMinimumBasicScenario-1469591209 tempest-TestMinimumBasicScenario-1469591209-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-2096645998" status: 202 len: 0 microversion: 2.1 time: 0.024673 Jul 18 10:34:26.824747 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 371/732] 10.222.0.33 () {58 vars in 1271 bytes} [Mon Jul 18 10:34:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-2096645998 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 10:34:27.313214 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-b9e39d93-9aec-4026-9a11-ebf502481c39 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:34:27.313913 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-b9e39d93-9aec-4026-9a11-ebf502481c39 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] [instance: b1a84290-3520-427e-af49-f380d2a144bb] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:34:27.320441 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-b9e39d93-9aec-4026-9a11-ebf502481c39 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:34:27.320908 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-b9e39d93-9aec-4026-9a11-ebf502481c39 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:34:27.321687 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-b9e39d93-9aec-4026-9a11-ebf502481c39 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:34:27.322210 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-b9e39d93-9aec-4026-9a11-ebf502481c39 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:34:27.467496 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-b9e39d93-9aec-4026-9a11-ebf502481c39 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:34:27.475690 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-b9e39d93-9aec-4026-9a11-ebf502481c39 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:34:27.477814 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-b9e39d93-9aec-4026-9a11-ebf502481c39 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:34:27.478907 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-b9e39d93-9aec-4026-9a11-ebf502481c39 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] 10.222.0.33 "GET /compute/v2.1/servers/b1a84290-3520-427e-af49-f380d2a144bb" status: 200 len: 1407 microversion: 2.20 time: 0.170063 Jul 18 10:34:27.479592 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 362/733] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jul 18 10:34:27 2022] GET /compute/v2.1/servers/b1a84290-3520-427e-af49-f380d2a144bb => generated 1407 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:34:27.505632 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [req-39d3f277-3259-4d48-bb2e-e9512e26a040 req-ebd70c2f-f766-415a-9d62-b848e4614320 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "72245495-f5b8-4f54-8d17-ec3e700bdd9b", "tag": "bab76dc7-a21a-4a7f-826e-1410690583a4"}]} {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:34:27.514843 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [req-39d3f277-3259-4d48-bb2e-e9512e26a040 req-ebd70c2f-f766-415a-9d62-b848e4614320 service nova] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:34:27.515426 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [req-39d3f277-3259-4d48-bb2e-e9512e26a040 req-ebd70c2f-f766-415a-9d62-b848e4614320 service nova] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:34:27.526038 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.compute.server_external_events [req-39d3f277-3259-4d48-bb2e-e9512e26a040 req-ebd70c2f-f766-415a-9d62-b848e4614320 service nova] Creating event network-changed:bab76dc7-a21a-4a7f-826e-1410690583a4 for instance 72245495-f5b8-4f54-8d17-ec3e700bdd9b on hv-cinder-83754 Jul 18 10:34:27.530828 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [req-39d3f277-3259-4d48-bb2e-e9512e26a040 req-ebd70c2f-f766-415a-9d62-b848e4614320 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103212 Jul 18 10:34:27.531461 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 372/734] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jul 18 10:34:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:34:27.651423 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-b010eda6-9ddd-4eb2-bc17-444685c44c99 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:34:27.652028 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-b010eda6-9ddd-4eb2-bc17-444685c44c99 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] [instance: 72245495-f5b8-4f54-8d17-ec3e700bdd9b] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:34:27.659235 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-b010eda6-9ddd-4eb2-bc17-444685c44c99 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:34:27.659698 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-b010eda6-9ddd-4eb2-bc17-444685c44c99 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:34:27.660450 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-b010eda6-9ddd-4eb2-bc17-444685c44c99 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:34:27.660900 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-b010eda6-9ddd-4eb2-bc17-444685c44c99 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:34:27.793635 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-b010eda6-9ddd-4eb2-bc17-444685c44c99 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f25c72896a2d4d619e5ad4b5a0a79aa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cf3d5bfe9a745f38372c42c9cfa1f63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:34:27.800960 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-b010eda6-9ddd-4eb2-bc17-444685c44c99 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] 10.222.0.33 "GET /compute/v2.1/servers/72245495-f5b8-4f54-8d17-ec3e700bdd9b" status: 200 len: 1368 microversion: 2.1 time: 0.153470 Jul 18 10:34:27.801512 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 363/735] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:34:27 2022] GET /compute/v2.1/servers/72245495-f5b8-4f54-8d17-ec3e700bdd9b => generated 1368 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:34:28.497285 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-d261ee85-d40b-4549-8b38-120b7a6b8494 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:34:28.498136 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-d261ee85-d40b-4549-8b38-120b7a6b8494 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] [instance: b1a84290-3520-427e-af49-f380d2a144bb] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:34:28.504800 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-d261ee85-d40b-4549-8b38-120b7a6b8494 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:34:28.505249 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-d261ee85-d40b-4549-8b38-120b7a6b8494 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:34:28.506020 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-d261ee85-d40b-4549-8b38-120b7a6b8494 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:34:28.506545 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-d261ee85-d40b-4549-8b38-120b7a6b8494 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:34:28.650617 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-d261ee85-d40b-4549-8b38-120b7a6b8494 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:34:28.661567 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-d261ee85-d40b-4549-8b38-120b7a6b8494 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:34:28.663075 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-d261ee85-d40b-4549-8b38-120b7a6b8494 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:34:28.664487 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-d261ee85-d40b-4549-8b38-120b7a6b8494 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] 10.222.0.33 "GET /compute/v2.1/servers/b1a84290-3520-427e-af49-f380d2a144bb" status: 200 len: 1407 microversion: 2.20 time: 0.171589 Jul 18 10:34:28.665088 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 373/736] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jul 18 10:34:28 2022] GET /compute/v2.1/servers/b1a84290-3520-427e-af49-f380d2a144bb => generated 1407 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:34:28.819001 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-85386dde-cb81-43d6-9683-33a8bd07bc11 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:34:28.819590 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-85386dde-cb81-43d6-9683-33a8bd07bc11 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] [instance: 72245495-f5b8-4f54-8d17-ec3e700bdd9b] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:34:28.826149 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-85386dde-cb81-43d6-9683-33a8bd07bc11 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:34:28.826547 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-85386dde-cb81-43d6-9683-33a8bd07bc11 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:34:28.827315 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-85386dde-cb81-43d6-9683-33a8bd07bc11 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:34:28.827749 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-85386dde-cb81-43d6-9683-33a8bd07bc11 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:34:28.958252 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-85386dde-cb81-43d6-9683-33a8bd07bc11 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f25c72896a2d4d619e5ad4b5a0a79aa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cf3d5bfe9a745f38372c42c9cfa1f63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:34:28.965808 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-85386dde-cb81-43d6-9683-33a8bd07bc11 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] 10.222.0.33 "GET /compute/v2.1/servers/72245495-f5b8-4f54-8d17-ec3e700bdd9b" status: 200 len: 1368 microversion: 2.1 time: 0.150728 Jul 18 10:34:28.966447 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 364/737] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:34:28 2022] GET /compute/v2.1/servers/72245495-f5b8-4f54-8d17-ec3e700bdd9b => generated 1368 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:34:29.682482 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-a9ec0d71-1e69-400e-8df4-3743bf388c64 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:34:29.683914 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-a9ec0d71-1e69-400e-8df4-3743bf388c64 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] [instance: b1a84290-3520-427e-af49-f380d2a144bb] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:34:29.691470 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-a9ec0d71-1e69-400e-8df4-3743bf388c64 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:34:29.692204 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-a9ec0d71-1e69-400e-8df4-3743bf388c64 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:34:29.693172 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-a9ec0d71-1e69-400e-8df4-3743bf388c64 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:34:29.693824 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-a9ec0d71-1e69-400e-8df4-3743bf388c64 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:34:29.878777 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-a9ec0d71-1e69-400e-8df4-3743bf388c64 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:34:29.887414 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-a9ec0d71-1e69-400e-8df4-3743bf388c64 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:34:29.889250 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-a9ec0d71-1e69-400e-8df4-3743bf388c64 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:34:29.890528 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-a9ec0d71-1e69-400e-8df4-3743bf388c64 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] 10.222.0.33 "GET /compute/v2.1/servers/b1a84290-3520-427e-af49-f380d2a144bb" status: 200 len: 1407 microversion: 2.20 time: 0.212062 Jul 18 10:34:29.891218 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 374/738] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jul 18 10:34:29 2022] GET /compute/v2.1/servers/b1a84290-3520-427e-af49-f380d2a144bb => generated 1407 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:34:29.983585 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-854a04be-1298-4eaf-bda7-21ed376a22ca tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:34:29.985137 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-854a04be-1298-4eaf-bda7-21ed376a22ca tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] [instance: 72245495-f5b8-4f54-8d17-ec3e700bdd9b] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:34:29.991760 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-854a04be-1298-4eaf-bda7-21ed376a22ca tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:34:29.992206 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-854a04be-1298-4eaf-bda7-21ed376a22ca tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:34:29.992999 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-854a04be-1298-4eaf-bda7-21ed376a22ca tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:34:29.993428 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-854a04be-1298-4eaf-bda7-21ed376a22ca tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:34:30.183017 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-854a04be-1298-4eaf-bda7-21ed376a22ca tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f25c72896a2d4d619e5ad4b5a0a79aa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cf3d5bfe9a745f38372c42c9cfa1f63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:34:30.190617 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-854a04be-1298-4eaf-bda7-21ed376a22ca tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] 10.222.0.33 "GET /compute/v2.1/servers/72245495-f5b8-4f54-8d17-ec3e700bdd9b" status: 200 len: 1368 microversion: 2.1 time: 0.210865 Jul 18 10:34:30.202841 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 365/739] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:34:29 2022] GET /compute/v2.1/servers/72245495-f5b8-4f54-8d17-ec3e700bdd9b => generated 1368 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:34:30.910058 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-1004f000-41a0-4558-be46-25166d39dd11 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:34:30.910671 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-1004f000-41a0-4558-be46-25166d39dd11 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] [instance: b1a84290-3520-427e-af49-f380d2a144bb] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:34:30.917850 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-1004f000-41a0-4558-be46-25166d39dd11 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:34:30.918364 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-1004f000-41a0-4558-be46-25166d39dd11 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:34:30.919144 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-1004f000-41a0-4558-be46-25166d39dd11 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:34:30.919605 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-1004f000-41a0-4558-be46-25166d39dd11 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:34:31.148029 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-1004f000-41a0-4558-be46-25166d39dd11 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:34:31.156131 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-1004f000-41a0-4558-be46-25166d39dd11 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:34:31.157655 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-1004f000-41a0-4558-be46-25166d39dd11 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:34:31.158770 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-1004f000-41a0-4558-be46-25166d39dd11 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] 10.222.0.33 "GET /compute/v2.1/servers/b1a84290-3520-427e-af49-f380d2a144bb" status: 200 len: 1407 microversion: 2.20 time: 0.253267 Jul 18 10:34:31.159320 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 375/740] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jul 18 10:34:30 2022] GET /compute/v2.1/servers/b1a84290-3520-427e-af49-f380d2a144bb => generated 1407 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 10:34:31.210394 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-7fcabe50-5da2-479a-af20-ca0c969ef510 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:34:31.211069 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-7fcabe50-5da2-479a-af20-ca0c969ef510 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] [instance: 72245495-f5b8-4f54-8d17-ec3e700bdd9b] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:34:31.218539 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-7fcabe50-5da2-479a-af20-ca0c969ef510 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:34:31.218977 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-7fcabe50-5da2-479a-af20-ca0c969ef510 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:34:31.220032 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-7fcabe50-5da2-479a-af20-ca0c969ef510 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:34:31.220461 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-7fcabe50-5da2-479a-af20-ca0c969ef510 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:34:31.433210 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-7fcabe50-5da2-479a-af20-ca0c969ef510 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f25c72896a2d4d619e5ad4b5a0a79aa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cf3d5bfe9a745f38372c42c9cfa1f63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:34:31.441675 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-7fcabe50-5da2-479a-af20-ca0c969ef510 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] 10.222.0.33 "GET /compute/v2.1/servers/72245495-f5b8-4f54-8d17-ec3e700bdd9b" status: 200 len: 1368 microversion: 2.1 time: 0.235152 Jul 18 10:34:31.442506 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 366/741] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:34:31 2022] GET /compute/v2.1/servers/72245495-f5b8-4f54-8d17-ec3e700bdd9b => generated 1368 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:34:31.629958 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [req-d190b4cf-1a46-48d4-be76-2056b87621db req-cf7bd41d-005c-418b-9fa6-188e71326e8f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b1a84290-3520-427e-af49-f380d2a144bb", "name": "network-vif-plugged", "status": "completed", "tag": "b5aa065e-e228-4681-909e-bd39389938fd"}]} {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:34:31.638456 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [req-d190b4cf-1a46-48d4-be76-2056b87621db req-cf7bd41d-005c-418b-9fa6-188e71326e8f service nova] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:34:31.638815 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [req-d190b4cf-1a46-48d4-be76-2056b87621db req-cf7bd41d-005c-418b-9fa6-188e71326e8f service nova] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:34:31.655132 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.compute.server_external_events [req-d190b4cf-1a46-48d4-be76-2056b87621db req-cf7bd41d-005c-418b-9fa6-188e71326e8f service nova] Creating event network-vif-plugged:b5aa065e-e228-4681-909e-bd39389938fd for instance b1a84290-3520-427e-af49-f380d2a144bb on hv-cinder-83754 Jul 18 10:34:31.660179 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [req-d190b4cf-1a46-48d4-be76-2056b87621db req-cf7bd41d-005c-418b-9fa6-188e71326e8f service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033885 Jul 18 10:34:31.661268 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 376/742] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jul 18 10:34:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 10:34:32.177676 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-e135b24d-e353-48a4-b481-22225ab0ff08 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:34:32.178561 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-e135b24d-e353-48a4-b481-22225ab0ff08 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] [instance: b1a84290-3520-427e-af49-f380d2a144bb] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:34:32.184417 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-e135b24d-e353-48a4-b481-22225ab0ff08 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:34:32.184901 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-e135b24d-e353-48a4-b481-22225ab0ff08 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:34:32.185661 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-e135b24d-e353-48a4-b481-22225ab0ff08 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:34:32.186088 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-e135b24d-e353-48a4-b481-22225ab0ff08 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:34:32.397193 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-e135b24d-e353-48a4-b481-22225ab0ff08 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:34:32.405687 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-e135b24d-e353-48a4-b481-22225ab0ff08 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:34:32.407952 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-e135b24d-e353-48a4-b481-22225ab0ff08 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:34:32.409164 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-e135b24d-e353-48a4-b481-22225ab0ff08 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] 10.222.0.33 "GET /compute/v2.1/servers/b1a84290-3520-427e-af49-f380d2a144bb" status: 200 len: 1407 microversion: 2.20 time: 0.236709 Jul 18 10:34:32.412609 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 367/743] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jul 18 10:34:32 2022] GET /compute/v2.1/servers/b1a84290-3520-427e-af49-f380d2a144bb => generated 1407 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:34:32.459275 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-77c2125f-6e35-44ae-a286-e1b9d23a7cce tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:34:32.459969 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-77c2125f-6e35-44ae-a286-e1b9d23a7cce tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] [instance: 72245495-f5b8-4f54-8d17-ec3e700bdd9b] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:34:32.466988 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-77c2125f-6e35-44ae-a286-e1b9d23a7cce tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:34:32.467442 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-77c2125f-6e35-44ae-a286-e1b9d23a7cce tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:34:32.468979 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-77c2125f-6e35-44ae-a286-e1b9d23a7cce tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:34:32.469416 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-77c2125f-6e35-44ae-a286-e1b9d23a7cce tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:34:32.616298 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-77c2125f-6e35-44ae-a286-e1b9d23a7cce tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f25c72896a2d4d619e5ad4b5a0a79aa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cf3d5bfe9a745f38372c42c9cfa1f63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:34:32.624540 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-77c2125f-6e35-44ae-a286-e1b9d23a7cce tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] 10.222.0.33 "GET /compute/v2.1/servers/72245495-f5b8-4f54-8d17-ec3e700bdd9b" status: 200 len: 1368 microversion: 2.1 time: 0.169391 Jul 18 10:34:32.625234 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 377/744] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:34:32 2022] GET /compute/v2.1/servers/72245495-f5b8-4f54-8d17-ec3e700bdd9b => generated 1368 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:34:33.426699 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-0214aef7-42a1-4d21-8f89-b9cfcbada430 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:34:33.427918 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-0214aef7-42a1-4d21-8f89-b9cfcbada430 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] [instance: b1a84290-3520-427e-af49-f380d2a144bb] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:34:33.433051 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG dbcounter [-] [117880] Writing DB stats nova_cell0:SELECT=4 {{(pid=117880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:34:33.434341 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG dbcounter [-] [117880] Writing DB stats nova_cell0:SELECT=20 {{(pid=117880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:34:33.437499 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-0214aef7-42a1-4d21-8f89-b9cfcbada430 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:34:33.438179 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-0214aef7-42a1-4d21-8f89-b9cfcbada430 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:34:33.439131 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-0214aef7-42a1-4d21-8f89-b9cfcbada430 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:34:33.439570 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-0214aef7-42a1-4d21-8f89-b9cfcbada430 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:34:33.638027 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG dbcounter [-] [117879] Writing DB stats nova_cell0:SELECT=4 {{(pid=117879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:34:33.643318 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-21f36b2e-e57e-4ab6-a144-b2011901b18d tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:34:33.643928 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-21f36b2e-e57e-4ab6-a144-b2011901b18d tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] [instance: 72245495-f5b8-4f54-8d17-ec3e700bdd9b] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:34:33.651178 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-21f36b2e-e57e-4ab6-a144-b2011901b18d tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:34:33.651636 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-21f36b2e-e57e-4ab6-a144-b2011901b18d tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:34:33.652610 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-21f36b2e-e57e-4ab6-a144-b2011901b18d tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:34:33.653208 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-21f36b2e-e57e-4ab6-a144-b2011901b18d tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:34:33.680450 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-0214aef7-42a1-4d21-8f89-b9cfcbada430 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:34:33.690211 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-0214aef7-42a1-4d21-8f89-b9cfcbada430 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:34:33.691696 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-0214aef7-42a1-4d21-8f89-b9cfcbada430 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:34:33.693062 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-0214aef7-42a1-4d21-8f89-b9cfcbada430 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] 10.222.0.33 "GET /compute/v2.1/servers/b1a84290-3520-427e-af49-f380d2a144bb" status: 200 len: 1407 microversion: 2.20 time: 0.270717 Jul 18 10:34:33.694119 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 368/745] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jul 18 10:34:33 2022] GET /compute/v2.1/servers/b1a84290-3520-427e-af49-f380d2a144bb => generated 1407 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:34:33.698747 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [req-933c3758-a844-4004-8b9d-8f33c38bd6c6 req-d602cf8b-0dc4-42a3-b35c-fdea8768353d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "72245495-f5b8-4f54-8d17-ec3e700bdd9b", "name": "network-vif-plugged", "status": "completed", "tag": "bab76dc7-a21a-4a7f-826e-1410690583a4"}]} {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:34:33.716805 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [req-933c3758-a844-4004-8b9d-8f33c38bd6c6 req-d602cf8b-0dc4-42a3-b35c-fdea8768353d service nova] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:34:33.717248 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [req-933c3758-a844-4004-8b9d-8f33c38bd6c6 req-d602cf8b-0dc4-42a3-b35c-fdea8768353d service nova] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:34:33.731212 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.compute.server_external_events [req-933c3758-a844-4004-8b9d-8f33c38bd6c6 req-d602cf8b-0dc4-42a3-b35c-fdea8768353d service nova] Creating event network-vif-plugged:bab76dc7-a21a-4a7f-826e-1410690583a4 for instance 72245495-f5b8-4f54-8d17-ec3e700bdd9b on hv-cinder-83754 Jul 18 10:34:33.736886 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [req-933c3758-a844-4004-8b9d-8f33c38bd6c6 req-d602cf8b-0dc4-42a3-b35c-fdea8768353d service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040797 Jul 18 10:34:33.737711 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 369/746] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jul 18 10:34:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:34:33.884152 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-21f36b2e-e57e-4ab6-a144-b2011901b18d tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f25c72896a2d4d619e5ad4b5a0a79aa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cf3d5bfe9a745f38372c42c9cfa1f63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:34:33.896204 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-21f36b2e-e57e-4ab6-a144-b2011901b18d tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] 10.222.0.33 "GET /compute/v2.1/servers/72245495-f5b8-4f54-8d17-ec3e700bdd9b" status: 200 len: 1368 microversion: 2.1 time: 0.258675 Jul 18 10:34:33.898114 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 378/747] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:34:33 2022] GET /compute/v2.1/servers/72245495-f5b8-4f54-8d17-ec3e700bdd9b => generated 1368 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:34:34.714263 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-a3b2a805-3f1f-4716-8b8e-2881d71e8ede tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:34:34.715606 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-a3b2a805-3f1f-4716-8b8e-2881d71e8ede tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] [instance: b1a84290-3520-427e-af49-f380d2a144bb] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:34:34.722852 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-a3b2a805-3f1f-4716-8b8e-2881d71e8ede tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:34:34.723300 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-a3b2a805-3f1f-4716-8b8e-2881d71e8ede tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:34:34.724086 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-a3b2a805-3f1f-4716-8b8e-2881d71e8ede tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:34:34.724519 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-a3b2a805-3f1f-4716-8b8e-2881d71e8ede tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:34:34.856338 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-a3b2a805-3f1f-4716-8b8e-2881d71e8ede tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:34:34.864738 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-a3b2a805-3f1f-4716-8b8e-2881d71e8ede tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:34:34.866347 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-a3b2a805-3f1f-4716-8b8e-2881d71e8ede tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:34:34.867494 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-a3b2a805-3f1f-4716-8b8e-2881d71e8ede tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] 10.222.0.33 "GET /compute/v2.1/servers/b1a84290-3520-427e-af49-f380d2a144bb" status: 200 len: 1599 microversion: 2.20 time: 0.157417 Jul 18 10:34:34.868041 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 370/748] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jul 18 10:34:34 2022] GET /compute/v2.1/servers/b1a84290-3520-427e-af49-f380d2a144bb => generated 1599 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:34:34.885121 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-d139801f-321a-4615-9a97-59ecc54dbd6d tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:34:34.885687 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-d139801f-321a-4615-9a97-59ecc54dbd6d tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] [instance: b1a84290-3520-427e-af49-f380d2a144bb] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:34:34.892435 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-d139801f-321a-4615-9a97-59ecc54dbd6d tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:34:34.892919 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-d139801f-321a-4615-9a97-59ecc54dbd6d tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:34:34.893688 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-d139801f-321a-4615-9a97-59ecc54dbd6d tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:34:34.894125 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-d139801f-321a-4615-9a97-59ecc54dbd6d tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:34:34.916842 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-a6829b90-9427-4ff3-87c3-1ea6fec7729c tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:34:34.917977 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-a6829b90-9427-4ff3-87c3-1ea6fec7729c tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] [instance: 72245495-f5b8-4f54-8d17-ec3e700bdd9b] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:34:34.924355 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-a6829b90-9427-4ff3-87c3-1ea6fec7729c tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:34:34.924981 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-a6829b90-9427-4ff3-87c3-1ea6fec7729c tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:34:34.926033 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-a6829b90-9427-4ff3-87c3-1ea6fec7729c tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:34:34.926722 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-a6829b90-9427-4ff3-87c3-1ea6fec7729c tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:34:35.272036 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-d139801f-321a-4615-9a97-59ecc54dbd6d tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] 10.222.0.33 "GET /compute/v2.1/servers/b1a84290-3520-427e-af49-f380d2a144bb/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.390665 Jul 18 10:34:35.272785 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 379/749] 10.222.0.33 () {60 vars in 1315 bytes} [Mon Jul 18 10:34:34 2022] GET /compute/v2.1/servers/b1a84290-3520-427e-af49-f380d2a144bb/os-interface => generated 284 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 10:34:35.339859 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-a6829b90-9427-4ff3-87c3-1ea6fec7729c tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f25c72896a2d4d619e5ad4b5a0a79aa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cf3d5bfe9a745f38372c42c9cfa1f63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:34:35.351197 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-a6829b90-9427-4ff3-87c3-1ea6fec7729c tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] 10.222.0.33 "GET /compute/v2.1/servers/72245495-f5b8-4f54-8d17-ec3e700bdd9b" status: 200 len: 1368 microversion: 2.1 time: 0.440534 Jul 18 10:34:35.360664 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 371/750] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:34:34 2022] GET /compute/v2.1/servers/72245495-f5b8-4f54-8d17-ec3e700bdd9b => generated 1368 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:34:36.367950 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-796aea6d-912e-44fe-9b17-862b2b63d5da tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:34:36.368578 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-796aea6d-912e-44fe-9b17-862b2b63d5da tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] [instance: 72245495-f5b8-4f54-8d17-ec3e700bdd9b] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:34:36.375272 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-796aea6d-912e-44fe-9b17-862b2b63d5da tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:34:36.375725 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-796aea6d-912e-44fe-9b17-862b2b63d5da tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:34:36.376761 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-796aea6d-912e-44fe-9b17-862b2b63d5da tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:34:36.377729 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-796aea6d-912e-44fe-9b17-862b2b63d5da tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:34:36.448069 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [req-e60ebf08-9b04-4d54-b7a6-22fcaed0aa4f req-a4066d1a-9adf-4af3-8756-895a7f5a80d2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b1a84290-3520-427e-af49-f380d2a144bb", "tag": "b5aa065e-e228-4681-909e-bd39389938fd"}]} {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:34:36.458966 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [req-e60ebf08-9b04-4d54-b7a6-22fcaed0aa4f req-a4066d1a-9adf-4af3-8756-895a7f5a80d2 service nova] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:34:36.461982 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [req-e60ebf08-9b04-4d54-b7a6-22fcaed0aa4f req-a4066d1a-9adf-4af3-8756-895a7f5a80d2 service nova] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:34:36.483602 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.compute.server_external_events [req-e60ebf08-9b04-4d54-b7a6-22fcaed0aa4f req-a4066d1a-9adf-4af3-8756-895a7f5a80d2 service nova] Creating event network-changed:b5aa065e-e228-4681-909e-bd39389938fd for instance b1a84290-3520-427e-af49-f380d2a144bb on hv-cinder-83754 Jul 18 10:34:36.490054 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [req-e60ebf08-9b04-4d54-b7a6-22fcaed0aa4f req-a4066d1a-9adf-4af3-8756-895a7f5a80d2 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.208678 Jul 18 10:34:36.491345 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 380/751] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jul 18 10:34:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:34:36.612240 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-796aea6d-912e-44fe-9b17-862b2b63d5da tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f25c72896a2d4d619e5ad4b5a0a79aa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cf3d5bfe9a745f38372c42c9cfa1f63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:34:36.619824 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-796aea6d-912e-44fe-9b17-862b2b63d5da tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] 10.222.0.33 "GET /compute/v2.1/servers/72245495-f5b8-4f54-8d17-ec3e700bdd9b" status: 200 len: 1559 microversion: 2.1 time: 0.255608 Jul 18 10:34:36.631751 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 372/752] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:34:36 2022] GET /compute/v2.1/servers/72245495-f5b8-4f54-8d17-ec3e700bdd9b => generated 1559 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:34:36.638472 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-fd67e8e4-757d-4f4b-acb6-68970aee69ca tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:34:36.639409 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-fd67e8e4-757d-4f4b-acb6-68970aee69ca tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] [instance: 72245495-f5b8-4f54-8d17-ec3e700bdd9b] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:34:36.649472 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-fd67e8e4-757d-4f4b-acb6-68970aee69ca tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:34:36.650027 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-fd67e8e4-757d-4f4b-acb6-68970aee69ca tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:34:36.651025 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-fd67e8e4-757d-4f4b-acb6-68970aee69ca tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:34:36.651755 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-fd67e8e4-757d-4f4b-acb6-68970aee69ca tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:34:36.768230 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-fd67e8e4-757d-4f4b-acb6-68970aee69ca tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] 10.222.0.33 "GET /compute/v2.1/servers/72245495-f5b8-4f54-8d17-ec3e700bdd9b/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.135056 Jul 18 10:34:36.769678 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 381/753] 10.222.0.33 () {58 vars in 1274 bytes} [Mon Jul 18 10:34:36 2022] GET /compute/v2.1/servers/72245495-f5b8-4f54-8d17-ec3e700bdd9b/os-interface => generated 285 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 10:34:38.516487 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [req-80111c63-6dd9-4b44-b8b3-c760c775b531 req-c2c0aec1-c3f0-499b-af15-5eaae5aa0ccd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "72245495-f5b8-4f54-8d17-ec3e700bdd9b", "tag": "bab76dc7-a21a-4a7f-826e-1410690583a4"}]} {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:34:38.524817 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [req-80111c63-6dd9-4b44-b8b3-c760c775b531 req-c2c0aec1-c3f0-499b-af15-5eaae5aa0ccd service nova] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:34:38.525538 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [req-80111c63-6dd9-4b44-b8b3-c760c775b531 req-c2c0aec1-c3f0-499b-af15-5eaae5aa0ccd service nova] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:34:38.537117 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.compute.server_external_events [req-80111c63-6dd9-4b44-b8b3-c760c775b531 req-c2c0aec1-c3f0-499b-af15-5eaae5aa0ccd service nova] Creating event network-changed:bab76dc7-a21a-4a7f-826e-1410690583a4 for instance 72245495-f5b8-4f54-8d17-ec3e700bdd9b on hv-cinder-83754 Jul 18 10:34:38.542407 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [req-80111c63-6dd9-4b44-b8b3-c760c775b531 req-c2c0aec1-c3f0-499b-af15-5eaae5aa0ccd service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030164 Jul 18 10:34:38.543002 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 373/754] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jul 18 10:34:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:34:45.791268 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-bede9474-63cf-4c71-811d-17f5267e741d tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] Action: 'create', calling method: .version_select at 0x7f9f4a193790>, body: {"keypair": {"name": "tempest-TestShelveInstance-1837206712", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBGpcfprg7tuOo0c1ZQR+Yy42pK8Hwy2otNEe9JoBDrBEdy9Rq9Tr+DkG/UrpuqR7vTABSa/hcCke/SYNubUXpd4nRrbWpdKmc5Ur0gO4ldz4AVgHKMZ3iHM1TkoSWOKqA=="}} {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:34:45.805542 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.quota [None req-bede9474-63cf-4c71-811d-17f5267e741d tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] Getting quotas for project 5628452a1ceb4af293ea96c187983fa6. Resources: {'key_pairs'} {{(pid=117879) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 10:34:45.813170 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.quota [None req-bede9474-63cf-4c71-811d-17f5267e741d tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] Getting quotas for user de7190c1ae524da280700ef2548a4a17 and project 5628452a1ceb4af293ea96c187983fa6. Resources: {'key_pairs'} {{(pid=117879) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 10:34:45.837355 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-bede9474-63cf-4c71-811d-17f5267e741d tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.221369 Jul 18 10:34:45.842921 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 382/755] 10.222.0.33 () {60 vars in 1158 bytes} [Mon Jul 18 10:34:45 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:35:02.003380 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-5d2e5b9f-76e7-48bb-9b9e-e7e8c97e57f2 tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-474662808", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1837206712", "security_groups": [{"name": "tempest-secgroup-smoke-1899579002"}], "networks": [{"uuid": "aa3e5fe6-aa22-4836-8d61-28fdcd6950fe"}], "block_device_mapping_v2": [{"uuid": "d2e12d2a-3200-458e-987f-fe73f4eccb97", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:35:02.011676 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG dbcounter [-] [117880] Writing DB stats nova_api:SELECT=57,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=117880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:35:02.012314 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG dbcounter [-] [117880] Writing DB stats nova_cell1:SELECT=78 {{(pid=117880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:35:02.115878 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.network.neutron [None req-5d2e5b9f-76e7-48bb-9b9e-e7e8c97e57f2 tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] validate_networks() for [('aa3e5fe6-aa22-4836-8d61-28fdcd6950fe', None, None, None, None, None)] {{(pid=117880) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 10:35:02.476378 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.virt.hardware [None req-5d2e5b9f-76e7-48bb-9b9e-e7e8c97e57f2 tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] Flavor limits 0:0:0 {{(pid=117880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 10:35:02.477157 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.virt.hardware [None req-5d2e5b9f-76e7-48bb-9b9e-e7e8c97e57f2 tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] Image limits 0:0:0 {{(pid=117880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 10:35:02.477632 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.virt.hardware [None req-5d2e5b9f-76e7-48bb-9b9e-e7e8c97e57f2 tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] Flavor pref 0:0:0 {{(pid=117880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 10:35:02.478038 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.virt.hardware [None req-5d2e5b9f-76e7-48bb-9b9e-e7e8c97e57f2 tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] Image pref 0:0:0 {{(pid=117880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 10:35:02.478448 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.virt.hardware [None req-5d2e5b9f-76e7-48bb-9b9e-e7e8c97e57f2 tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 10:35:02.487660 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-5d2e5b9f-76e7-48bb-9b9e-e7e8c97e57f2 tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:35:02.488108 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-5d2e5b9f-76e7-48bb-9b9e-e7e8c97e57f2 tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:35:02.488936 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-5d2e5b9f-76e7-48bb-9b9e-e7e8c97e57f2 tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:35:02.489370 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-5d2e5b9f-76e7-48bb-9b9e-e7e8c97e57f2 tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:35:02.506114 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.quota [None req-5d2e5b9f-76e7-48bb-9b9e-e7e8c97e57f2 tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] Getting quotas for project 5628452a1ceb4af293ea96c187983fa6. Resources: {'ram', 'cores', 'instances'} {{(pid=117880) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 10:35:02.509983 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.quota [None req-5d2e5b9f-76e7-48bb-9b9e-e7e8c97e57f2 tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] Getting quotas for user de7190c1ae524da280700ef2548a4a17 and project 5628452a1ceb4af293ea96c187983fa6. Resources: {'ram', 'cores', 'instances'} {{(pid=117880) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 10:35:02.571369 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-5d2e5b9f-76e7-48bb-9b9e-e7e8c97e57f2 tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] Going to run 1 instances... {{(pid=117880) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 10:35:02.573582 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-5d2e5b9f-76e7-48bb-9b9e-e7e8c97e57f2 tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] [instance: 00da9ad2-aef2-4a2b-8ae8-51ee9e41e049] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='d2e12d2a-3200-458e-987f-fe73f4eccb97',volume_size=None,volume_type=None)] {{(pid=117880) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 10:35:02.706115 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-5d2e5b9f-76e7-48bb-9b9e-e7e8c97e57f2 tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.707069 Jul 18 10:35:02.706975 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 374/756] 10.222.0.33 () {60 vars in 1146 bytes} [Mon Jul 18 10:35:01 2022] POST /compute/v2.1/servers => generated 406 bytes in 709 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 10:35:02.714541 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG dbcounter [-] [117879] Writing DB stats nova_cell1:SELECT=67 {{(pid=117879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:35:02.715391 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG dbcounter [-] [117879] Writing DB stats nova_cell0:SELECT=4 {{(pid=117879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:35:02.716175 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG dbcounter [-] [117879] Writing DB stats nova_api:SELECT=57,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=117879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:35:02.720273 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-59627f8d-1396-4fbc-afe1-fb207fa32324 tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:35:02.720913 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-59627f8d-1396-4fbc-afe1-fb207fa32324 tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] [instance: 00da9ad2-aef2-4a2b-8ae8-51ee9e41e049] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:35:02.778088 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-59627f8d-1396-4fbc-afe1-fb207fa32324 tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de7190c1ae524da280700ef2548a4a17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5628452a1ceb4af293ea96c187983fa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:35:02.785169 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-59627f8d-1396-4fbc-afe1-fb207fa32324 tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] 10.222.0.33 "GET /compute/v2.1/servers/00da9ad2-aef2-4a2b-8ae8-51ee9e41e049" status: 200 len: 1088 microversion: 2.1 time: 0.071985 Jul 18 10:35:02.785739 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 383/757] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:35:02 2022] GET /compute/v2.1/servers/00da9ad2-aef2-4a2b-8ae8-51ee9e41e049 => generated 1088 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:35:03.803245 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-3861e91c-78a5-4642-b21d-4144e1e56806 tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:35:03.803968 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-3861e91c-78a5-4642-b21d-4144e1e56806 tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] [instance: 00da9ad2-aef2-4a2b-8ae8-51ee9e41e049] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:35:03.811074 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-3861e91c-78a5-4642-b21d-4144e1e56806 tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:35:03.811642 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-3861e91c-78a5-4642-b21d-4144e1e56806 tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:35:03.812806 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-3861e91c-78a5-4642-b21d-4144e1e56806 tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:35:03.813480 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-3861e91c-78a5-4642-b21d-4144e1e56806 tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:35:03.894317 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-3861e91c-78a5-4642-b21d-4144e1e56806 tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de7190c1ae524da280700ef2548a4a17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5628452a1ceb4af293ea96c187983fa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:35:03.902527 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-3861e91c-78a5-4642-b21d-4144e1e56806 tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] 10.222.0.33 "GET /compute/v2.1/servers/00da9ad2-aef2-4a2b-8ae8-51ee9e41e049" status: 200 len: 1204 microversion: 2.1 time: 0.103960 Jul 18 10:35:03.903097 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 375/758] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:35:03 2022] GET /compute/v2.1/servers/00da9ad2-aef2-4a2b-8ae8-51ee9e41e049 => generated 1204 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:35:04.919157 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-aae523cf-8c13-4ece-a1d0-b3c561ac87e6 tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:35:04.919769 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-aae523cf-8c13-4ece-a1d0-b3c561ac87e6 tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] [instance: 00da9ad2-aef2-4a2b-8ae8-51ee9e41e049] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:35:04.934334 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-aae523cf-8c13-4ece-a1d0-b3c561ac87e6 tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:35:04.934870 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-aae523cf-8c13-4ece-a1d0-b3c561ac87e6 tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:35:04.935990 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-aae523cf-8c13-4ece-a1d0-b3c561ac87e6 tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:35:04.936674 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-aae523cf-8c13-4ece-a1d0-b3c561ac87e6 tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:35:05.164703 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [req-fe2c0731-1dfd-4126-a46e-d12d2c75e0dd req-b6edb8cd-4f95-4945-b334-6de020d755c0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "00da9ad2-aef2-4a2b-8ae8-51ee9e41e049", "tag": "01aa80e4-4901-4d77-80cb-a644fd1ee6ff"}]} {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:35:05.173392 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [req-fe2c0731-1dfd-4126-a46e-d12d2c75e0dd req-b6edb8cd-4f95-4945-b334-6de020d755c0 service nova] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:35:05.174730 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [req-fe2c0731-1dfd-4126-a46e-d12d2c75e0dd req-b6edb8cd-4f95-4945-b334-6de020d755c0 service nova] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:35:05.185871 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-aae523cf-8c13-4ece-a1d0-b3c561ac87e6 tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de7190c1ae524da280700ef2548a4a17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5628452a1ceb4af293ea96c187983fa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:35:05.188562 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.compute.server_external_events [req-fe2c0731-1dfd-4126-a46e-d12d2c75e0dd req-b6edb8cd-4f95-4945-b334-6de020d755c0 service nova] Creating event network-changed:01aa80e4-4901-4d77-80cb-a644fd1ee6ff for instance 00da9ad2-aef2-4a2b-8ae8-51ee9e41e049 on hv-cinder-83754 Jul 18 10:35:05.195920 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [req-fe2c0731-1dfd-4126-a46e-d12d2c75e0dd req-b6edb8cd-4f95-4945-b334-6de020d755c0 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039195 Jul 18 10:35:05.197126 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 376/759] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jul 18 10:35:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:35:05.197634 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-aae523cf-8c13-4ece-a1d0-b3c561ac87e6 tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] 10.222.0.33 "GET /compute/v2.1/servers/00da9ad2-aef2-4a2b-8ae8-51ee9e41e049" status: 200 len: 1260 microversion: 2.1 time: 0.281810 Jul 18 10:35:05.198220 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 384/760] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:35:04 2022] GET /compute/v2.1/servers/00da9ad2-aef2-4a2b-8ae8-51ee9e41e049 => generated 1260 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:35:06.214481 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-f674cc1e-5c95-4ebf-90d3-417ab3784826 tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:35:06.215077 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-f674cc1e-5c95-4ebf-90d3-417ab3784826 tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] [instance: 00da9ad2-aef2-4a2b-8ae8-51ee9e41e049] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:35:06.221881 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-f674cc1e-5c95-4ebf-90d3-417ab3784826 tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:35:06.222334 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-f674cc1e-5c95-4ebf-90d3-417ab3784826 tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:35:06.223109 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-f674cc1e-5c95-4ebf-90d3-417ab3784826 tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:35:06.223547 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-f674cc1e-5c95-4ebf-90d3-417ab3784826 tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:35:06.280954 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-f210dcae-9ca2-4985-9740-6abaed0b6f8f tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:35:06.281533 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-f210dcae-9ca2-4985-9740-6abaed0b6f8f tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] [instance: 9cdd676f-7b24-4c7e-849c-97e196465a3c] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:35:06.288298 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-f210dcae-9ca2-4985-9740-6abaed0b6f8f tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:35:06.288787 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-f210dcae-9ca2-4985-9740-6abaed0b6f8f tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:35:06.289548 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-f210dcae-9ca2-4985-9740-6abaed0b6f8f tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:35:06.289985 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-f210dcae-9ca2-4985-9740-6abaed0b6f8f tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:35:06.314489 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-f210dcae-9ca2-4985-9740-6abaed0b6f8f tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] 10.222.0.33 "GET /compute/v2.1/servers/9cdd676f-7b24-4c7e-849c-97e196465a3c/ips" status: 200 len: 145 microversion: 2.1 time: 0.148247 Jul 18 10:35:06.315073 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 377/761] 10.222.0.33 () {58 vars in 1247 bytes} [Mon Jul 18 10:35:06 2022] GET /compute/v2.1/servers/9cdd676f-7b24-4c7e-849c-97e196465a3c/ips => generated 145 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:35:06.405421 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-f674cc1e-5c95-4ebf-90d3-417ab3784826 tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de7190c1ae524da280700ef2548a4a17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5628452a1ceb4af293ea96c187983fa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:35:06.413640 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-f674cc1e-5c95-4ebf-90d3-417ab3784826 tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] 10.222.0.33 "GET /compute/v2.1/servers/00da9ad2-aef2-4a2b-8ae8-51ee9e41e049" status: 200 len: 1260 microversion: 2.1 time: 0.202844 Jul 18 10:35:06.414151 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 385/762] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:35:06 2022] GET /compute/v2.1/servers/00da9ad2-aef2-4a2b-8ae8-51ee9e41e049 => generated 1260 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:35:07.429787 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-48ae213f-8336-4c79-b3a6-cb73f5224817 tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:35:07.430317 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-48ae213f-8336-4c79-b3a6-cb73f5224817 tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] [instance: 00da9ad2-aef2-4a2b-8ae8-51ee9e41e049] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:35:07.436730 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-48ae213f-8336-4c79-b3a6-cb73f5224817 tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:35:07.437178 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-48ae213f-8336-4c79-b3a6-cb73f5224817 tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:35:07.437934 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-48ae213f-8336-4c79-b3a6-cb73f5224817 tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:35:07.438363 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-48ae213f-8336-4c79-b3a6-cb73f5224817 tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:35:07.568529 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-48ae213f-8336-4c79-b3a6-cb73f5224817 tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de7190c1ae524da280700ef2548a4a17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5628452a1ceb4af293ea96c187983fa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:35:07.578179 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-48ae213f-8336-4c79-b3a6-cb73f5224817 tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] 10.222.0.33 "GET /compute/v2.1/servers/00da9ad2-aef2-4a2b-8ae8-51ee9e41e049" status: 200 len: 1260 microversion: 2.1 time: 0.152063 Jul 18 10:35:07.578885 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 378/763] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:35:07 2022] GET /compute/v2.1/servers/00da9ad2-aef2-4a2b-8ae8-51ee9e41e049 => generated 1260 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:35:07.629020 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-8c7a2457-485b-46c3-9445-2e3047c40ea7 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "67aac3d6-3717-4ac0-8895-622d5d8961ef"}} {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:35:07.630142 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-8c7a2457-485b-46c3-9445-2e3047c40ea7 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] [instance: 9cdd676f-7b24-4c7e-849c-97e196465a3c] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:35:07.636533 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-8c7a2457-485b-46c3-9445-2e3047c40ea7 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:35:07.637008 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-8c7a2457-485b-46c3-9445-2e3047c40ea7 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:35:07.637772 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-8c7a2457-485b-46c3-9445-2e3047c40ea7 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:35:07.638213 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-8c7a2457-485b-46c3-9445-2e3047c40ea7 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:35:07.869842 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-8c7a2457-485b-46c3-9445-2e3047c40ea7 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] 10.222.0.33 "POST /compute/v2.1/servers/9cdd676f-7b24-4c7e-849c-97e196465a3c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.245310 Jul 18 10:35:07.870465 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 386/764] 10.222.0.33 () {60 vars in 1322 bytes} [Mon Jul 18 10:35:07 2022] POST /compute/v2.1/servers/9cdd676f-7b24-4c7e-849c-97e196465a3c/os-volume_attachments => generated 194 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:35:08.595106 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-81a2455c-e17d-4cc8-a97d-f9f87302c9b5 tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:35:08.595625 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-81a2455c-e17d-4cc8-a97d-f9f87302c9b5 tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] [instance: 00da9ad2-aef2-4a2b-8ae8-51ee9e41e049] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:35:08.602738 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-81a2455c-e17d-4cc8-a97d-f9f87302c9b5 tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:35:08.603187 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-81a2455c-e17d-4cc8-a97d-f9f87302c9b5 tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:35:08.603936 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-81a2455c-e17d-4cc8-a97d-f9f87302c9b5 tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:35:08.604364 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-81a2455c-e17d-4cc8-a97d-f9f87302c9b5 tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:35:08.737943 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-81a2455c-e17d-4cc8-a97d-f9f87302c9b5 tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de7190c1ae524da280700ef2548a4a17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5628452a1ceb4af293ea96c187983fa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:35:08.745304 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-81a2455c-e17d-4cc8-a97d-f9f87302c9b5 tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] 10.222.0.33 "GET /compute/v2.1/servers/00da9ad2-aef2-4a2b-8ae8-51ee9e41e049" status: 200 len: 1260 microversion: 2.1 time: 0.154118 Jul 18 10:35:08.745866 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 379/765] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:35:08 2022] GET /compute/v2.1/servers/00da9ad2-aef2-4a2b-8ae8-51ee9e41e049 => generated 1260 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:35:09.762083 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-ff732708-ef80-4a9d-8ac0-21ab0e234e6e tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:35:09.762779 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-ff732708-ef80-4a9d-8ac0-21ab0e234e6e tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] [instance: 00da9ad2-aef2-4a2b-8ae8-51ee9e41e049] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:35:09.769990 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-ff732708-ef80-4a9d-8ac0-21ab0e234e6e tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:35:09.770433 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-ff732708-ef80-4a9d-8ac0-21ab0e234e6e tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:35:09.771199 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-ff732708-ef80-4a9d-8ac0-21ab0e234e6e tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:35:09.771632 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-ff732708-ef80-4a9d-8ac0-21ab0e234e6e tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:35:09.904623 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-ff732708-ef80-4a9d-8ac0-21ab0e234e6e tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de7190c1ae524da280700ef2548a4a17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5628452a1ceb4af293ea96c187983fa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:35:09.912398 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-ff732708-ef80-4a9d-8ac0-21ab0e234e6e tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] 10.222.0.33 "GET /compute/v2.1/servers/00da9ad2-aef2-4a2b-8ae8-51ee9e41e049" status: 200 len: 1260 microversion: 2.1 time: 0.154539 Jul 18 10:35:09.913014 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 387/766] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:35:09 2022] GET /compute/v2.1/servers/00da9ad2-aef2-4a2b-8ae8-51ee9e41e049 => generated 1260 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:35:10.928493 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-b0b0d1ba-fa48-4651-9979-61245cd5fb62 tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:35:10.929123 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-b0b0d1ba-fa48-4651-9979-61245cd5fb62 tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] [instance: 00da9ad2-aef2-4a2b-8ae8-51ee9e41e049] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:35:10.935563 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-b0b0d1ba-fa48-4651-9979-61245cd5fb62 tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:35:10.936005 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-b0b0d1ba-fa48-4651-9979-61245cd5fb62 tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:35:10.936772 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-b0b0d1ba-fa48-4651-9979-61245cd5fb62 tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:35:10.937197 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-b0b0d1ba-fa48-4651-9979-61245cd5fb62 tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:35:11.067139 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-b0b0d1ba-fa48-4651-9979-61245cd5fb62 tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de7190c1ae524da280700ef2548a4a17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5628452a1ceb4af293ea96c187983fa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:35:11.074528 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-b0b0d1ba-fa48-4651-9979-61245cd5fb62 tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] 10.222.0.33 "GET /compute/v2.1/servers/00da9ad2-aef2-4a2b-8ae8-51ee9e41e049" status: 200 len: 1260 microversion: 2.1 time: 0.149891 Jul 18 10:35:11.075091 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 380/767] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:35:10 2022] GET /compute/v2.1/servers/00da9ad2-aef2-4a2b-8ae8-51ee9e41e049 => generated 1260 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:35:12.091177 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-52cc38e6-0170-4e85-a41d-c813de8dda8c tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:35:12.091806 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-52cc38e6-0170-4e85-a41d-c813de8dda8c tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] [instance: 00da9ad2-aef2-4a2b-8ae8-51ee9e41e049] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:35:12.098334 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-52cc38e6-0170-4e85-a41d-c813de8dda8c tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:35:12.098765 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-52cc38e6-0170-4e85-a41d-c813de8dda8c tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:35:12.099448 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-52cc38e6-0170-4e85-a41d-c813de8dda8c tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:35:12.099878 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-52cc38e6-0170-4e85-a41d-c813de8dda8c tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:35:12.231428 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-52cc38e6-0170-4e85-a41d-c813de8dda8c tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de7190c1ae524da280700ef2548a4a17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5628452a1ceb4af293ea96c187983fa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:35:12.238992 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-52cc38e6-0170-4e85-a41d-c813de8dda8c tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] 10.222.0.33 "GET /compute/v2.1/servers/00da9ad2-aef2-4a2b-8ae8-51ee9e41e049" status: 200 len: 1260 microversion: 2.1 time: 0.151610 Jul 18 10:35:12.239558 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 388/768] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:35:12 2022] GET /compute/v2.1/servers/00da9ad2-aef2-4a2b-8ae8-51ee9e41e049 => generated 1260 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:35:12.959571 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-2622b30e-88ec-4c22-a79d-c209c1d0577e tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:35:12.960071 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-2622b30e-88ec-4c22-a79d-c209c1d0577e tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] [instance: b1a84290-3520-427e-af49-f380d2a144bb] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:35:12.962486 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG dbcounter [-] [117880] Writing DB stats nova_cell0:SELECT=2 {{(pid=117880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:35:12.963218 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG dbcounter [-] [117880] Writing DB stats nova_cell0:SELECT=6 {{(pid=117880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:35:12.968972 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-2622b30e-88ec-4c22-a79d-c209c1d0577e tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:35:12.969419 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-2622b30e-88ec-4c22-a79d-c209c1d0577e tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:35:12.970184 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-2622b30e-88ec-4c22-a79d-c209c1d0577e tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:35:12.970615 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-2622b30e-88ec-4c22-a79d-c209c1d0577e tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:35:12.993118 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-2622b30e-88ec-4c22-a79d-c209c1d0577e tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] 10.222.0.33 "GET /compute/v2.1/servers/b1a84290-3520-427e-af49-f380d2a144bb/ips" status: 200 len: 152 microversion: 2.20 time: 0.037988 Jul 18 10:35:12.993669 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 381/769] 10.222.0.33 () {60 vars in 1288 bytes} [Mon Jul 18 10:35:12 2022] GET /compute/v2.1/servers/b1a84290-3520-427e-af49-f380d2a144bb/ips => generated 152 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 10:35:13.255905 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-84eb9277-15f7-4ebd-a814-4d3352387fdd tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:35:13.256521 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-84eb9277-15f7-4ebd-a814-4d3352387fdd tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] [instance: 00da9ad2-aef2-4a2b-8ae8-51ee9e41e049] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:35:13.260654 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG dbcounter [-] [117879] Writing DB stats nova_cell0:SELECT=2 {{(pid=117879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:35:13.265869 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-84eb9277-15f7-4ebd-a814-4d3352387fdd tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:35:13.266288 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-84eb9277-15f7-4ebd-a814-4d3352387fdd tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:35:13.267094 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-84eb9277-15f7-4ebd-a814-4d3352387fdd tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:35:13.267555 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-84eb9277-15f7-4ebd-a814-4d3352387fdd tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:35:13.402264 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-84eb9277-15f7-4ebd-a814-4d3352387fdd tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de7190c1ae524da280700ef2548a4a17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5628452a1ceb4af293ea96c187983fa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:35:13.409753 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-84eb9277-15f7-4ebd-a814-4d3352387fdd tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] 10.222.0.33 "GET /compute/v2.1/servers/00da9ad2-aef2-4a2b-8ae8-51ee9e41e049" status: 200 len: 1260 microversion: 2.1 time: 0.158421 Jul 18 10:35:13.410315 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 389/770] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:35:13 2022] GET /compute/v2.1/servers/00da9ad2-aef2-4a2b-8ae8-51ee9e41e049 => generated 1260 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:35:14.426484 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-ad4d42b7-ab33-4e45-a721-04a90ca2df8b tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:35:14.427086 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-ad4d42b7-ab33-4e45-a721-04a90ca2df8b tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] [instance: 00da9ad2-aef2-4a2b-8ae8-51ee9e41e049] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:35:14.433452 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-ad4d42b7-ab33-4e45-a721-04a90ca2df8b tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:35:14.433923 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-ad4d42b7-ab33-4e45-a721-04a90ca2df8b tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:35:14.434675 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-ad4d42b7-ab33-4e45-a721-04a90ca2df8b tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:35:14.435100 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-ad4d42b7-ab33-4e45-a721-04a90ca2df8b tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:35:14.561647 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-ad4d42b7-ab33-4e45-a721-04a90ca2df8b tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de7190c1ae524da280700ef2548a4a17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5628452a1ceb4af293ea96c187983fa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:35:14.569431 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-ad4d42b7-ab33-4e45-a721-04a90ca2df8b tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] 10.222.0.33 "GET /compute/v2.1/servers/00da9ad2-aef2-4a2b-8ae8-51ee9e41e049" status: 200 len: 1260 microversion: 2.1 time: 0.146823 Jul 18 10:35:14.569981 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 382/771] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:35:14 2022] GET /compute/v2.1/servers/00da9ad2-aef2-4a2b-8ae8-51ee9e41e049 => generated 1260 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:35:15.368966 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-17cb2677-a4dc-4fdd-87e3-a01e2b13b211 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:35:15.369911 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-17cb2677-a4dc-4fdd-87e3-a01e2b13b211 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] [instance: 9cdd676f-7b24-4c7e-849c-97e196465a3c] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:35:15.376206 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-17cb2677-a4dc-4fdd-87e3-a01e2b13b211 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:35:15.376701 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-17cb2677-a4dc-4fdd-87e3-a01e2b13b211 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:35:15.377456 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-17cb2677-a4dc-4fdd-87e3-a01e2b13b211 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:35:15.377890 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-17cb2677-a4dc-4fdd-87e3-a01e2b13b211 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:35:15.405893 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-17cb2677-a4dc-4fdd-87e3-a01e2b13b211 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] 10.222.0.33 "GET /compute/v2.1/servers/9cdd676f-7b24-4c7e-849c-97e196465a3c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040842 Jul 18 10:35:15.406615 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 390/772] 10.222.0.33 () {58 vars in 1301 bytes} [Mon Jul 18 10:35:15 2022] GET /compute/v2.1/servers/9cdd676f-7b24-4c7e-849c-97e196465a3c/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:35:15.416828 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-e687d271-58f9-4f62-bf04-8ff557370258 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:35:15.417258 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-e687d271-58f9-4f62-bf04-8ff557370258 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] [instance: 9cdd676f-7b24-4c7e-849c-97e196465a3c] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:35:15.423086 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-e687d271-58f9-4f62-bf04-8ff557370258 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:35:15.423531 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-e687d271-58f9-4f62-bf04-8ff557370258 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:35:15.424291 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-e687d271-58f9-4f62-bf04-8ff557370258 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:35:15.424757 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-e687d271-58f9-4f62-bf04-8ff557370258 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:35:15.451985 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-e687d271-58f9-4f62-bf04-8ff557370258 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] 10.222.0.33 "GET /compute/v2.1/servers/9cdd676f-7b24-4c7e-849c-97e196465a3c/os-volume_attachments/67aac3d6-3717-4ac0-8895-622d5d8961ef" status: 200 len: 194 microversion: 2.1 time: 0.039113 Jul 18 10:35:15.452638 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 383/773] 10.222.0.33 () {58 vars in 1412 bytes} [Mon Jul 18 10:35:15 2022] GET /compute/v2.1/servers/9cdd676f-7b24-4c7e-849c-97e196465a3c/os-volume_attachments/67aac3d6-3717-4ac0-8895-622d5d8961ef => generated 194 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:35:15.586768 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-8b9ef204-bcb6-43f3-a25e-c69101db96fe tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:35:15.587356 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-8b9ef204-bcb6-43f3-a25e-c69101db96fe tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] [instance: 00da9ad2-aef2-4a2b-8ae8-51ee9e41e049] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:35:15.593557 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-8b9ef204-bcb6-43f3-a25e-c69101db96fe tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:35:15.594006 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-8b9ef204-bcb6-43f3-a25e-c69101db96fe tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:35:15.595135 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-8b9ef204-bcb6-43f3-a25e-c69101db96fe tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:35:15.596182 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-8b9ef204-bcb6-43f3-a25e-c69101db96fe tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:35:15.872622 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [req-231b8103-48de-4f2c-9e65-d3671ad7210f req-66ac59e4-fe84-4016-9781-6f6e779b1b3d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "00da9ad2-aef2-4a2b-8ae8-51ee9e41e049", "name": "network-vif-plugged", "status": "completed", "tag": "01aa80e4-4901-4d77-80cb-a644fd1ee6ff"}]} {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:35:15.882728 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [req-231b8103-48de-4f2c-9e65-d3671ad7210f req-66ac59e4-fe84-4016-9781-6f6e779b1b3d service nova] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:35:15.883206 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [req-231b8103-48de-4f2c-9e65-d3671ad7210f req-66ac59e4-fe84-4016-9781-6f6e779b1b3d service nova] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:35:15.895416 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.compute.server_external_events [req-231b8103-48de-4f2c-9e65-d3671ad7210f req-66ac59e4-fe84-4016-9781-6f6e779b1b3d service nova] Creating event network-vif-plugged:01aa80e4-4901-4d77-80cb-a644fd1ee6ff for instance 00da9ad2-aef2-4a2b-8ae8-51ee9e41e049 on hv-cinder-83754 Jul 18 10:35:15.901317 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [req-231b8103-48de-4f2c-9e65-d3671ad7210f req-66ac59e4-fe84-4016-9781-6f6e779b1b3d service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102491 Jul 18 10:35:15.902130 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 384/774] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jul 18 10:35:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 10:35:16.015968 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-8b9ef204-bcb6-43f3-a25e-c69101db96fe tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de7190c1ae524da280700ef2548a4a17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5628452a1ceb4af293ea96c187983fa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:35:16.024016 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-8b9ef204-bcb6-43f3-a25e-c69101db96fe tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] 10.222.0.33 "GET /compute/v2.1/servers/00da9ad2-aef2-4a2b-8ae8-51ee9e41e049" status: 200 len: 1260 microversion: 2.1 time: 0.440970 Jul 18 10:35:16.024684 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 391/775] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:35:15 2022] GET /compute/v2.1/servers/00da9ad2-aef2-4a2b-8ae8-51ee9e41e049 => generated 1260 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:35:16.245780 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-4b8f569f-18ce-408d-98f5-ad952d783cef tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:35:16.246315 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-4b8f569f-18ce-408d-98f5-ad952d783cef tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] [instance: b1a84290-3520-427e-af49-f380d2a144bb] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:35:16.252550 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-4b8f569f-18ce-408d-98f5-ad952d783cef tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:35:16.253002 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-4b8f569f-18ce-408d-98f5-ad952d783cef tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:35:16.253759 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-4b8f569f-18ce-408d-98f5-ad952d783cef tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:35:16.254194 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-4b8f569f-18ce-408d-98f5-ad952d783cef tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:35:16.277976 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.objects.instance [None req-4b8f569f-18ce-408d-98f5-ad952d783cef tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lazy-loading 'flavor' on Instance uuid b1a84290-3520-427e-af49-f380d2a144bb {{(pid=117880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 10:35:16.531365 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-4b8f569f-18ce-408d-98f5-ad952d783cef tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] 10.222.0.33 "POST /compute/v2.1/servers/b1a84290-3520-427e-af49-f380d2a144bb/action" status: 202 len: 0 microversion: 2.20 time: 0.289681 Jul 18 10:35:16.531962 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 385/776] 10.222.0.33 () {62 vars in 1318 bytes} [Mon Jul 18 10:35:16 2022] POST /compute/v2.1/servers/b1a84290-3520-427e-af49-f380d2a144bb/action => generated 0 bytes in 291 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 18 10:35:16.540290 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-f5a2a108-2540-4f57-a49f-09d9902f8c0e tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:35:16.541489 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-f5a2a108-2540-4f57-a49f-09d9902f8c0e tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] [instance: b1a84290-3520-427e-af49-f380d2a144bb] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:35:16.548325 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-f5a2a108-2540-4f57-a49f-09d9902f8c0e tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:35:16.548910 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-f5a2a108-2540-4f57-a49f-09d9902f8c0e tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:35:16.549721 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-f5a2a108-2540-4f57-a49f-09d9902f8c0e tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:35:16.550196 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-f5a2a108-2540-4f57-a49f-09d9902f8c0e tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:35:16.688573 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-f5a2a108-2540-4f57-a49f-09d9902f8c0e tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:35:16.696882 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-f5a2a108-2540-4f57-a49f-09d9902f8c0e tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:35:16.698399 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-f5a2a108-2540-4f57-a49f-09d9902f8c0e tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:35:16.699568 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-f5a2a108-2540-4f57-a49f-09d9902f8c0e tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] 10.222.0.33 "GET /compute/v2.1/servers/b1a84290-3520-427e-af49-f380d2a144bb" status: 200 len: 1724 microversion: 2.20 time: 0.163226 Jul 18 10:35:16.700124 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 392/777] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jul 18 10:35:16 2022] GET /compute/v2.1/servers/b1a84290-3520-427e-af49-f380d2a144bb => generated 1724 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 10:35:16.809869 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-1fbe4750-18f1-4e17-b713-10d12d9c3368 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "80694cf1-1957-459f-a90c-e9223d94c284"}} {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:35:16.811026 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-1fbe4750-18f1-4e17-b713-10d12d9c3368 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] [instance: 9cdd676f-7b24-4c7e-849c-97e196465a3c] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:35:16.817712 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-1fbe4750-18f1-4e17-b713-10d12d9c3368 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:35:16.818158 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-1fbe4750-18f1-4e17-b713-10d12d9c3368 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:35:16.818923 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-1fbe4750-18f1-4e17-b713-10d12d9c3368 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:35:16.819358 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-1fbe4750-18f1-4e17-b713-10d12d9c3368 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:35:17.041108 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-e4ec4e98-8c9b-4b4b-9c47-6b5154af6a6c tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:35:17.041635 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-e4ec4e98-8c9b-4b4b-9c47-6b5154af6a6c tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] [instance: 00da9ad2-aef2-4a2b-8ae8-51ee9e41e049] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:35:17.047667 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-e4ec4e98-8c9b-4b4b-9c47-6b5154af6a6c tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:35:17.048110 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-e4ec4e98-8c9b-4b4b-9c47-6b5154af6a6c tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:35:17.048908 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-e4ec4e98-8c9b-4b4b-9c47-6b5154af6a6c tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:35:17.049353 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-e4ec4e98-8c9b-4b4b-9c47-6b5154af6a6c tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:35:17.191873 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-1fbe4750-18f1-4e17-b713-10d12d9c3368 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] 10.222.0.33 "POST /compute/v2.1/servers/9cdd676f-7b24-4c7e-849c-97e196465a3c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.386154 Jul 18 10:35:17.192130 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-e4ec4e98-8c9b-4b4b-9c47-6b5154af6a6c tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de7190c1ae524da280700ef2548a4a17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5628452a1ceb4af293ea96c187983fa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:35:17.196585 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 386/778] 10.222.0.33 () {60 vars in 1322 bytes} [Mon Jul 18 10:35:16 2022] POST /compute/v2.1/servers/9cdd676f-7b24-4c7e-849c-97e196465a3c/os-volume_attachments => generated 194 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:35:17.200911 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-e4ec4e98-8c9b-4b4b-9c47-6b5154af6a6c tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] 10.222.0.33 "GET /compute/v2.1/servers/00da9ad2-aef2-4a2b-8ae8-51ee9e41e049" status: 200 len: 1260 microversion: 2.1 time: 0.163691 Jul 18 10:35:17.201492 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 393/779] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:35:17 2022] GET /compute/v2.1/servers/00da9ad2-aef2-4a2b-8ae8-51ee9e41e049 => generated 1260 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:35:17.719864 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-fd892e1f-a431-4b59-87ae-18160876afa3 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:35:17.720320 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-fd892e1f-a431-4b59-87ae-18160876afa3 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] [instance: b1a84290-3520-427e-af49-f380d2a144bb] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:35:17.728056 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-fd892e1f-a431-4b59-87ae-18160876afa3 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:35:17.728512 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-fd892e1f-a431-4b59-87ae-18160876afa3 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:35:17.729303 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-fd892e1f-a431-4b59-87ae-18160876afa3 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:35:17.729732 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-fd892e1f-a431-4b59-87ae-18160876afa3 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:35:17.870171 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-fd892e1f-a431-4b59-87ae-18160876afa3 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:35:17.878168 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-fd892e1f-a431-4b59-87ae-18160876afa3 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:35:17.879662 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-fd892e1f-a431-4b59-87ae-18160876afa3 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:35:17.880833 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-fd892e1f-a431-4b59-87ae-18160876afa3 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] 10.222.0.33 "GET /compute/v2.1/servers/b1a84290-3520-427e-af49-f380d2a144bb" status: 200 len: 1724 microversion: 2.20 time: 0.165842 Jul 18 10:35:17.881517 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 387/780] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jul 18 10:35:17 2022] GET /compute/v2.1/servers/b1a84290-3520-427e-af49-f380d2a144bb => generated 1724 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:35:18.216610 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-cbf76d70-3aa6-41b4-bb9d-2873abe33858 tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:35:18.217252 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-cbf76d70-3aa6-41b4-bb9d-2873abe33858 tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] [instance: 00da9ad2-aef2-4a2b-8ae8-51ee9e41e049] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:35:18.223724 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-cbf76d70-3aa6-41b4-bb9d-2873abe33858 tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:35:18.224176 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-cbf76d70-3aa6-41b4-bb9d-2873abe33858 tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:35:18.224979 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-cbf76d70-3aa6-41b4-bb9d-2873abe33858 tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:35:18.225418 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-cbf76d70-3aa6-41b4-bb9d-2873abe33858 tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:35:18.361008 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-cbf76d70-3aa6-41b4-bb9d-2873abe33858 tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de7190c1ae524da280700ef2548a4a17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5628452a1ceb4af293ea96c187983fa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:35:18.368910 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-cbf76d70-3aa6-41b4-bb9d-2873abe33858 tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] 10.222.0.33 "GET /compute/v2.1/servers/00da9ad2-aef2-4a2b-8ae8-51ee9e41e049" status: 200 len: 1444 microversion: 2.1 time: 0.156130 Jul 18 10:35:18.369478 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 394/781] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:35:18 2022] GET /compute/v2.1/servers/00da9ad2-aef2-4a2b-8ae8-51ee9e41e049 => generated 1444 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:35:18.386023 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-b710c477-2fc6-405c-9ba8-d047e786b6b3 tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:35:18.386637 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-b710c477-2fc6-405c-9ba8-d047e786b6b3 tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] [instance: 00da9ad2-aef2-4a2b-8ae8-51ee9e41e049] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:35:18.394166 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-b710c477-2fc6-405c-9ba8-d047e786b6b3 tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:35:18.394794 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-b710c477-2fc6-405c-9ba8-d047e786b6b3 tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:35:18.395381 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-b710c477-2fc6-405c-9ba8-d047e786b6b3 tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:35:18.395812 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-b710c477-2fc6-405c-9ba8-d047e786b6b3 tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:35:18.523047 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-b710c477-2fc6-405c-9ba8-d047e786b6b3 tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de7190c1ae524da280700ef2548a4a17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5628452a1ceb4af293ea96c187983fa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:35:18.530387 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-b710c477-2fc6-405c-9ba8-d047e786b6b3 tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] 10.222.0.33 "GET /compute/v2.1/servers/00da9ad2-aef2-4a2b-8ae8-51ee9e41e049" status: 200 len: 1444 microversion: 2.1 time: 0.148791 Jul 18 10:35:18.530943 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 388/782] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:35:18 2022] GET /compute/v2.1/servers/00da9ad2-aef2-4a2b-8ae8-51ee9e41e049 => generated 1444 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:35:18.898522 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-7bf1e3b0-e0c3-48c9-ad60-39eb867b7a6b tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:35:18.899105 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-7bf1e3b0-e0c3-48c9-ad60-39eb867b7a6b tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] [instance: b1a84290-3520-427e-af49-f380d2a144bb] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:35:18.905365 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-7bf1e3b0-e0c3-48c9-ad60-39eb867b7a6b tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:35:18.905826 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-7bf1e3b0-e0c3-48c9-ad60-39eb867b7a6b tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:35:18.906602 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-7bf1e3b0-e0c3-48c9-ad60-39eb867b7a6b tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:35:18.907046 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-7bf1e3b0-e0c3-48c9-ad60-39eb867b7a6b tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:35:19.096867 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-7bf1e3b0-e0c3-48c9-ad60-39eb867b7a6b tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:35:19.106344 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-7bf1e3b0-e0c3-48c9-ad60-39eb867b7a6b tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:35:19.107827 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-7bf1e3b0-e0c3-48c9-ad60-39eb867b7a6b tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:35:19.109040 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-7bf1e3b0-e0c3-48c9-ad60-39eb867b7a6b tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] 10.222.0.33 "GET /compute/v2.1/servers/b1a84290-3520-427e-af49-f380d2a144bb" status: 200 len: 1724 microversion: 2.20 time: 0.214516 Jul 18 10:35:19.109600 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 395/783] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jul 18 10:35:18 2022] GET /compute/v2.1/servers/b1a84290-3520-427e-af49-f380d2a144bb => generated 1724 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:35:20.126006 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-382db76b-0d44-4c99-9902-6e9b98014e7f tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:35:20.126609 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-382db76b-0d44-4c99-9902-6e9b98014e7f tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] [instance: b1a84290-3520-427e-af49-f380d2a144bb] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:35:20.133530 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-382db76b-0d44-4c99-9902-6e9b98014e7f tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:35:20.133976 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-382db76b-0d44-4c99-9902-6e9b98014e7f tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:35:20.134738 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-382db76b-0d44-4c99-9902-6e9b98014e7f tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:35:20.135169 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-382db76b-0d44-4c99-9902-6e9b98014e7f tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:35:20.327714 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-382db76b-0d44-4c99-9902-6e9b98014e7f tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:35:20.332976 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG dbcounter [-] [117880] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=117880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:35:20.338721 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-382db76b-0d44-4c99-9902-6e9b98014e7f tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:35:20.340348 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-382db76b-0d44-4c99-9902-6e9b98014e7f tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:35:20.341657 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-382db76b-0d44-4c99-9902-6e9b98014e7f tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] 10.222.0.33 "GET /compute/v2.1/servers/b1a84290-3520-427e-af49-f380d2a144bb" status: 200 len: 1724 microversion: 2.20 time: 0.219372 Jul 18 10:35:20.347887 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 389/784] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jul 18 10:35:20 2022] GET /compute/v2.1/servers/b1a84290-3520-427e-af49-f380d2a144bb => generated 1724 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:35:20.374487 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [req-4ee40a76-e4e7-4bcf-890a-cc217d7ef4f9 req-c52b6ffa-5b02-4d1d-a73a-2ebd447fd815 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "00da9ad2-aef2-4a2b-8ae8-51ee9e41e049", "tag": "01aa80e4-4901-4d77-80cb-a644fd1ee6ff"}]} {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:35:20.382868 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [req-4ee40a76-e4e7-4bcf-890a-cc217d7ef4f9 req-c52b6ffa-5b02-4d1d-a73a-2ebd447fd815 service nova] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:35:20.383261 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [req-4ee40a76-e4e7-4bcf-890a-cc217d7ef4f9 req-c52b6ffa-5b02-4d1d-a73a-2ebd447fd815 service nova] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:35:20.397648 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.compute.server_external_events [req-4ee40a76-e4e7-4bcf-890a-cc217d7ef4f9 req-c52b6ffa-5b02-4d1d-a73a-2ebd447fd815 service nova] Creating event network-changed:01aa80e4-4901-4d77-80cb-a644fd1ee6ff for instance 00da9ad2-aef2-4a2b-8ae8-51ee9e41e049 on hv-cinder-83754 Jul 18 10:35:20.402633 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [req-4ee40a76-e4e7-4bcf-890a-cc217d7ef4f9 req-c52b6ffa-5b02-4d1d-a73a-2ebd447fd815 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031579 Jul 18 10:35:20.403501 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 396/785] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jul 18 10:35:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:35:21.362512 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-8919ac43-7090-413c-aa2e-22c139fd889f tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:35:21.363804 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-8919ac43-7090-413c-aa2e-22c139fd889f tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] [instance: b1a84290-3520-427e-af49-f380d2a144bb] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:35:21.371725 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-8919ac43-7090-413c-aa2e-22c139fd889f tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:35:21.372264 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-8919ac43-7090-413c-aa2e-22c139fd889f tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:35:21.373243 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-8919ac43-7090-413c-aa2e-22c139fd889f tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:35:21.373738 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-8919ac43-7090-413c-aa2e-22c139fd889f tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:35:21.509857 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-8919ac43-7090-413c-aa2e-22c139fd889f tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:35:21.517582 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-8919ac43-7090-413c-aa2e-22c139fd889f tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:35:21.519055 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-8919ac43-7090-413c-aa2e-22c139fd889f tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:35:21.520182 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-8919ac43-7090-413c-aa2e-22c139fd889f tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] 10.222.0.33 "GET /compute/v2.1/servers/b1a84290-3520-427e-af49-f380d2a144bb" status: 200 len: 1724 microversion: 2.20 time: 0.163849 Jul 18 10:35:21.520769 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 390/786] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jul 18 10:35:21 2022] GET /compute/v2.1/servers/b1a84290-3520-427e-af49-f380d2a144bb => generated 1724 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:35:22.087628 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-f90a93fe-c5c0-427d-bed0-8f3940ec130d tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:35:22.088155 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-f90a93fe-c5c0-427d-bed0-8f3940ec130d tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] [instance: 72245495-f5b8-4f54-8d17-ec3e700bdd9b] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:35:22.094283 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-f90a93fe-c5c0-427d-bed0-8f3940ec130d tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:35:22.094722 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-f90a93fe-c5c0-427d-bed0-8f3940ec130d tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:35:22.095471 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-f90a93fe-c5c0-427d-bed0-8f3940ec130d tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:35:22.095899 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-f90a93fe-c5c0-427d-bed0-8f3940ec130d tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:35:22.118463 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-f90a93fe-c5c0-427d-bed0-8f3940ec130d tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] 10.222.0.33 "GET /compute/v2.1/servers/72245495-f5b8-4f54-8d17-ec3e700bdd9b/ips" status: 200 len: 150 microversion: 2.1 time: 0.035659 Jul 18 10:35:22.119017 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 397/787] 10.222.0.33 () {58 vars in 1247 bytes} [Mon Jul 18 10:35:22 2022] GET /compute/v2.1/servers/72245495-f5b8-4f54-8d17-ec3e700bdd9b/ips => generated 150 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:35:22.537821 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-814ab732-4569-4741-bc1e-9b3a59e15e92 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:35:22.538420 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-814ab732-4569-4741-bc1e-9b3a59e15e92 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] [instance: b1a84290-3520-427e-af49-f380d2a144bb] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:35:22.544697 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-814ab732-4569-4741-bc1e-9b3a59e15e92 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:35:22.545140 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-814ab732-4569-4741-bc1e-9b3a59e15e92 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:35:22.545885 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-814ab732-4569-4741-bc1e-9b3a59e15e92 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:35:22.546308 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-814ab732-4569-4741-bc1e-9b3a59e15e92 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:35:22.678616 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-814ab732-4569-4741-bc1e-9b3a59e15e92 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:35:22.686422 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-814ab732-4569-4741-bc1e-9b3a59e15e92 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:35:22.687905 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-814ab732-4569-4741-bc1e-9b3a59e15e92 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:35:22.689088 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-814ab732-4569-4741-bc1e-9b3a59e15e92 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] 10.222.0.33 "GET /compute/v2.1/servers/b1a84290-3520-427e-af49-f380d2a144bb" status: 200 len: 1724 microversion: 2.20 time: 0.155093 Jul 18 10:35:22.689631 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 391/788] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jul 18 10:35:22 2022] GET /compute/v2.1/servers/b1a84290-3520-427e-af49-f380d2a144bb => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:35:23.437114 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-718d48f7-2a22-48ef-9d80-bac3e5c1387d tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d84e3059-632c-48fb-93be-fa036aa65e2f"}} {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:35:23.438164 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-718d48f7-2a22-48ef-9d80-bac3e5c1387d tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] [instance: 72245495-f5b8-4f54-8d17-ec3e700bdd9b] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:35:23.445154 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-718d48f7-2a22-48ef-9d80-bac3e5c1387d tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:35:23.445598 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-718d48f7-2a22-48ef-9d80-bac3e5c1387d tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:35:23.446377 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-718d48f7-2a22-48ef-9d80-bac3e5c1387d tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:35:23.446806 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-718d48f7-2a22-48ef-9d80-bac3e5c1387d tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:35:23.595673 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-97fed60d-ba06-45b9-8902-bdc4d8ce37fd tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:35:23.596174 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-97fed60d-ba06-45b9-8902-bdc4d8ce37fd tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] [instance: 22a03003-3677-426e-8fb8-5b58998eef8a] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:35:23.603077 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-97fed60d-ba06-45b9-8902-bdc4d8ce37fd tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:35:23.603530 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-97fed60d-ba06-45b9-8902-bdc4d8ce37fd tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:35:23.604299 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-97fed60d-ba06-45b9-8902-bdc4d8ce37fd tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:35:23.604767 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-97fed60d-ba06-45b9-8902-bdc4d8ce37fd tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:35:23.630418 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-97fed60d-ba06-45b9-8902-bdc4d8ce37fd tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] [instance: 22a03003-3677-426e-8fb8-5b58998eef8a] Going to try to terminate instance {{(pid=117880) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 10:35:23.707207 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-97fed60d-ba06-45b9-8902-bdc4d8ce37fd tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] 10.222.0.33 "DELETE /compute/v2.1/servers/22a03003-3677-426e-8fb8-5b58998eef8a" status: 204 len: 0 microversion: 2.1 time: 0.114959 Jul 18 10:35:23.707599 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 392/789] 10.222.0.33 () {58 vars in 1238 bytes} [Mon Jul 18 10:35:23 2022] DELETE /compute/v2.1/servers/22a03003-3677-426e-8fb8-5b58998eef8a => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 18 10:35:23.712411 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-8fc414a6-b123-460e-a6c6-cca485f0f86e tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:35:23.713143 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-8fc414a6-b123-460e-a6c6-cca485f0f86e tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] [instance: b1a84290-3520-427e-af49-f380d2a144bb] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:35:23.718865 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-8fc414a6-b123-460e-a6c6-cca485f0f86e tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:35:23.719306 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-8fc414a6-b123-460e-a6c6-cca485f0f86e tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:35:23.720056 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-8fc414a6-b123-460e-a6c6-cca485f0f86e tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:35:23.720480 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-8fc414a6-b123-460e-a6c6-cca485f0f86e tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:35:23.790077 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG dbcounter [-] [117879] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=117879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:35:23.801853 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-718d48f7-2a22-48ef-9d80-bac3e5c1387d tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] 10.222.0.33 "POST /compute/v2.1/servers/72245495-f5b8-4f54-8d17-ec3e700bdd9b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.368527 Jul 18 10:35:23.802477 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 398/790] 10.222.0.33 () {60 vars in 1322 bytes} [Mon Jul 18 10:35:23 2022] POST /compute/v2.1/servers/72245495-f5b8-4f54-8d17-ec3e700bdd9b/os-volume_attachments => generated 194 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:35:23.811290 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-efaef38f-1fc8-4762-b58a-459c2a79bd84 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:35:23.811992 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-efaef38f-1fc8-4762-b58a-459c2a79bd84 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] [instance: 22a03003-3677-426e-8fb8-5b58998eef8a] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:35:23.819228 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-efaef38f-1fc8-4762-b58a-459c2a79bd84 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:35:23.819683 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-efaef38f-1fc8-4762-b58a-459c2a79bd84 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:35:23.820494 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-efaef38f-1fc8-4762-b58a-459c2a79bd84 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:35:23.820957 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-efaef38f-1fc8-4762-b58a-459c2a79bd84 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:35:23.860303 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-8fc414a6-b123-460e-a6c6-cca485f0f86e tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:35:23.869433 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-8fc414a6-b123-460e-a6c6-cca485f0f86e tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:35:23.870967 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-8fc414a6-b123-460e-a6c6-cca485f0f86e tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:35:23.872158 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-8fc414a6-b123-460e-a6c6-cca485f0f86e tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] 10.222.0.33 "GET /compute/v2.1/servers/b1a84290-3520-427e-af49-f380d2a144bb" status: 200 len: 1724 microversion: 2.20 time: 0.163484 Jul 18 10:35:23.872742 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 393/791] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jul 18 10:35:23 2022] GET /compute/v2.1/servers/b1a84290-3520-427e-af49-f380d2a144bb => generated 1724 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:35:23.958959 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-efaef38f-1fc8-4762-b58a-459c2a79bd84 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9eb8d188e040bca894e038955f2402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c656b71bbd447cba7d11335c928dfda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:35:23.966396 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-efaef38f-1fc8-4762-b58a-459c2a79bd84 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] 10.222.0.33 "GET /compute/v2.1/servers/22a03003-3677-426e-8fb8-5b58998eef8a" status: 200 len: 1575 microversion: 2.1 time: 0.162731 Jul 18 10:35:23.966953 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 399/792] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:35:23 2022] GET /compute/v2.1/servers/22a03003-3677-426e-8fb8-5b58998eef8a => generated 1575 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:35:24.889860 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-d350d98e-f5dd-48a6-9a05-a54a33087092 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:35:24.890467 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-d350d98e-f5dd-48a6-9a05-a54a33087092 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] [instance: b1a84290-3520-427e-af49-f380d2a144bb] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:35:24.896894 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-d350d98e-f5dd-48a6-9a05-a54a33087092 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:35:24.897345 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-d350d98e-f5dd-48a6-9a05-a54a33087092 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:35:24.898141 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-d350d98e-f5dd-48a6-9a05-a54a33087092 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:35:24.898668 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-d350d98e-f5dd-48a6-9a05-a54a33087092 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:35:24.984432 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-85ea3e32-0189-4648-b372-3f751b56ffe7 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:35:24.985175 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-85ea3e32-0189-4648-b372-3f751b56ffe7 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] [instance: 22a03003-3677-426e-8fb8-5b58998eef8a] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:35:24.992226 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-85ea3e32-0189-4648-b372-3f751b56ffe7 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:35:24.992715 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-85ea3e32-0189-4648-b372-3f751b56ffe7 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:35:24.993483 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-85ea3e32-0189-4648-b372-3f751b56ffe7 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:35:24.993948 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-85ea3e32-0189-4648-b372-3f751b56ffe7 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:35:25.027795 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-d350d98e-f5dd-48a6-9a05-a54a33087092 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:35:25.036532 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-d350d98e-f5dd-48a6-9a05-a54a33087092 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:35:25.038041 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-d350d98e-f5dd-48a6-9a05-a54a33087092 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:35:25.039199 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-d350d98e-f5dd-48a6-9a05-a54a33087092 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] 10.222.0.33 "GET /compute/v2.1/servers/b1a84290-3520-427e-af49-f380d2a144bb" status: 200 len: 1724 microversion: 2.20 time: 0.153217 Jul 18 10:35:25.039760 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 394/793] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jul 18 10:35:24 2022] GET /compute/v2.1/servers/b1a84290-3520-427e-af49-f380d2a144bb => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:35:25.126958 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-85ea3e32-0189-4648-b372-3f751b56ffe7 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9eb8d188e040bca894e038955f2402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c656b71bbd447cba7d11335c928dfda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:35:25.134508 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-85ea3e32-0189-4648-b372-3f751b56ffe7 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] 10.222.0.33 "GET /compute/v2.1/servers/22a03003-3677-426e-8fb8-5b58998eef8a" status: 200 len: 1575 microversion: 2.1 time: 0.153818 Jul 18 10:35:25.135063 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 400/794] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:35:24 2022] GET /compute/v2.1/servers/22a03003-3677-426e-8fb8-5b58998eef8a => generated 1575 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:35:25.740520 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-3af3047e-fb65-4808-b644-97d9d6514d13 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:35:25.741571 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-3af3047e-fb65-4808-b644-97d9d6514d13 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] [instance: 9cdd676f-7b24-4c7e-849c-97e196465a3c] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:35:25.747453 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-3af3047e-fb65-4808-b644-97d9d6514d13 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:35:25.747899 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-3af3047e-fb65-4808-b644-97d9d6514d13 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:35:25.748708 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-3af3047e-fb65-4808-b644-97d9d6514d13 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:35:25.749142 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-3af3047e-fb65-4808-b644-97d9d6514d13 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:35:25.778146 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-3af3047e-fb65-4808-b644-97d9d6514d13 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] 10.222.0.33 "GET /compute/v2.1/servers/9cdd676f-7b24-4c7e-849c-97e196465a3c/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042035 Jul 18 10:35:25.778691 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 395/795] 10.222.0.33 () {58 vars in 1301 bytes} [Mon Jul 18 10:35:25 2022] GET /compute/v2.1/servers/9cdd676f-7b24-4c7e-849c-97e196465a3c/os-volume_attachments => generated 371 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:35:25.924232 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-f39ba7bd-836b-4763-a1b6-9d5cb61f99d9 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:35:25.924758 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-f39ba7bd-836b-4763-a1b6-9d5cb61f99d9 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] [instance: 9cdd676f-7b24-4c7e-849c-97e196465a3c] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:35:25.931972 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-f39ba7bd-836b-4763-a1b6-9d5cb61f99d9 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:35:25.932362 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-f39ba7bd-836b-4763-a1b6-9d5cb61f99d9 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:35:25.933723 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-f39ba7bd-836b-4763-a1b6-9d5cb61f99d9 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:35:25.934168 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-f39ba7bd-836b-4763-a1b6-9d5cb61f99d9 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:35:25.974444 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-f39ba7bd-836b-4763-a1b6-9d5cb61f99d9 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] 10.222.0.33 "GET /compute/v2.1/servers/9cdd676f-7b24-4c7e-849c-97e196465a3c/os-volume_attachments/67aac3d6-3717-4ac0-8895-622d5d8961ef" status: 200 len: 194 microversion: 2.1 time: 0.054078 Jul 18 10:35:25.979608 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 401/796] 10.222.0.33 () {58 vars in 1412 bytes} [Mon Jul 18 10:35:25 2022] GET /compute/v2.1/servers/9cdd676f-7b24-4c7e-849c-97e196465a3c/os-volume_attachments/67aac3d6-3717-4ac0-8895-622d5d8961ef => generated 194 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:35:25.984815 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-58137747-5aae-47f1-97e4-e7b5f8992247 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:35:25.985325 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-58137747-5aae-47f1-97e4-e7b5f8992247 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] [instance: 9cdd676f-7b24-4c7e-849c-97e196465a3c] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:35:25.992031 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-58137747-5aae-47f1-97e4-e7b5f8992247 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:35:25.992482 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-58137747-5aae-47f1-97e4-e7b5f8992247 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:35:25.993265 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-58137747-5aae-47f1-97e4-e7b5f8992247 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:35:25.993696 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-58137747-5aae-47f1-97e4-e7b5f8992247 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:35:26.057118 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-338c28d4-d4be-4484-9259-de853355a8b4 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:35:26.058247 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-338c28d4-d4be-4484-9259-de853355a8b4 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] [instance: b1a84290-3520-427e-af49-f380d2a144bb] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:35:26.064247 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-338c28d4-d4be-4484-9259-de853355a8b4 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:35:26.064722 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-338c28d4-d4be-4484-9259-de853355a8b4 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:35:26.065574 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-338c28d4-d4be-4484-9259-de853355a8b4 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:35:26.066015 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-338c28d4-d4be-4484-9259-de853355a8b4 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:35:26.084490 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.objects.instance [None req-58137747-5aae-47f1-97e4-e7b5f8992247 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lazy-loading 'services' on Instance uuid 9cdd676f-7b24-4c7e-849c-97e196465a3c {{(pid=117880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 10:35:26.166379 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-58137747-5aae-47f1-97e4-e7b5f8992247 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] 10.222.0.33 "DELETE /compute/v2.1/servers/9cdd676f-7b24-4c7e-849c-97e196465a3c/os-volume_attachments/67aac3d6-3717-4ac0-8895-622d5d8961ef" status: 202 len: 0 microversion: 2.1 time: 0.185200 Jul 18 10:35:26.167281 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 396/797] 10.222.0.33 () {58 vars in 1415 bytes} [Mon Jul 18 10:35:25 2022] DELETE /compute/v2.1/servers/9cdd676f-7b24-4c7e-849c-97e196465a3c/os-volume_attachments/67aac3d6-3717-4ac0-8895-622d5d8961ef => generated 0 bytes in 187 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 10:35:26.185176 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-816926e7-fa02-4378-9e2e-0eb2ca3a69e0 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:35:26.188645 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-816926e7-fa02-4378-9e2e-0eb2ca3a69e0 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] [instance: 22a03003-3677-426e-8fb8-5b58998eef8a] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:35:26.199347 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-816926e7-fa02-4378-9e2e-0eb2ca3a69e0 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:35:26.199805 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-816926e7-fa02-4378-9e2e-0eb2ca3a69e0 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:35:26.200804 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-816926e7-fa02-4378-9e2e-0eb2ca3a69e0 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:35:26.201280 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-816926e7-fa02-4378-9e2e-0eb2ca3a69e0 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:35:26.329708 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-338c28d4-d4be-4484-9259-de853355a8b4 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:35:26.338127 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-338c28d4-d4be-4484-9259-de853355a8b4 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:35:26.339608 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-338c28d4-d4be-4484-9259-de853355a8b4 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:35:26.340795 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-338c28d4-d4be-4484-9259-de853355a8b4 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] 10.222.0.33 "GET /compute/v2.1/servers/b1a84290-3520-427e-af49-f380d2a144bb" status: 200 len: 1724 microversion: 2.20 time: 0.287405 Jul 18 10:35:26.341347 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 402/798] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jul 18 10:35:26 2022] GET /compute/v2.1/servers/b1a84290-3520-427e-af49-f380d2a144bb => generated 1724 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 10:35:26.474304 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-816926e7-fa02-4378-9e2e-0eb2ca3a69e0 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9eb8d188e040bca894e038955f2402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c656b71bbd447cba7d11335c928dfda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:35:26.482006 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-816926e7-fa02-4378-9e2e-0eb2ca3a69e0 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] 10.222.0.33 "GET /compute/v2.1/servers/22a03003-3677-426e-8fb8-5b58998eef8a" status: 200 len: 1575 microversion: 2.1 time: 0.313349 Jul 18 10:35:26.482562 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 397/799] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:35:26 2022] GET /compute/v2.1/servers/22a03003-3677-426e-8fb8-5b58998eef8a => generated 1575 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:35:27.196232 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [req-26e61538-97ab-4548-a56f-ad589ecf07ac req-5ab74827-4fd5-4f0b-882b-77d5692ce7dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22a03003-3677-426e-8fb8-5b58998eef8a", "name": "network-vif-deleted", "tag": "de125830-3de3-492c-bc45-25ee6ef36473"}]} {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:35:27.209793 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [req-26e61538-97ab-4548-a56f-ad589ecf07ac req-5ab74827-4fd5-4f0b-882b-77d5692ce7dc service nova] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:35:27.210249 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [req-26e61538-97ab-4548-a56f-ad589ecf07ac req-5ab74827-4fd5-4f0b-882b-77d5692ce7dc service nova] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:35:27.223245 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.compute.server_external_events [req-26e61538-97ab-4548-a56f-ad589ecf07ac req-5ab74827-4fd5-4f0b-882b-77d5692ce7dc service nova] Creating event network-vif-deleted:de125830-3de3-492c-bc45-25ee6ef36473 for instance 22a03003-3677-426e-8fb8-5b58998eef8a on hv-cinder-83754 Jul 18 10:35:27.229446 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [req-26e61538-97ab-4548-a56f-ad589ecf07ac req-5ab74827-4fd5-4f0b-882b-77d5692ce7dc service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036777 Jul 18 10:35:27.230222 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 403/800] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jul 18 10:35:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 10:35:27.359277 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-00b47d90-b5b1-4100-93d2-073c3bf10391 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:35:27.359886 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-00b47d90-b5b1-4100-93d2-073c3bf10391 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] [instance: b1a84290-3520-427e-af49-f380d2a144bb] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:35:27.367386 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-00b47d90-b5b1-4100-93d2-073c3bf10391 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:35:27.367840 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-00b47d90-b5b1-4100-93d2-073c3bf10391 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:35:27.368636 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-00b47d90-b5b1-4100-93d2-073c3bf10391 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:35:27.369112 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-00b47d90-b5b1-4100-93d2-073c3bf10391 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:35:27.499042 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-93dc76c2-0fb4-41e5-b646-255bb51ef495 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:35:27.500085 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-93dc76c2-0fb4-41e5-b646-255bb51ef495 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] [instance: 22a03003-3677-426e-8fb8-5b58998eef8a] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:35:27.506999 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-93dc76c2-0fb4-41e5-b646-255bb51ef495 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:35:27.507451 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-93dc76c2-0fb4-41e5-b646-255bb51ef495 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:35:27.508390 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-93dc76c2-0fb4-41e5-b646-255bb51ef495 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:35:27.509006 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-93dc76c2-0fb4-41e5-b646-255bb51ef495 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:35:27.521032 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-00b47d90-b5b1-4100-93d2-073c3bf10391 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:35:27.530406 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-00b47d90-b5b1-4100-93d2-073c3bf10391 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:35:27.532003 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-00b47d90-b5b1-4100-93d2-073c3bf10391 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:35:27.533280 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-00b47d90-b5b1-4100-93d2-073c3bf10391 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] 10.222.0.33 "GET /compute/v2.1/servers/b1a84290-3520-427e-af49-f380d2a144bb" status: 200 len: 1724 microversion: 2.20 time: 0.177951 Jul 18 10:35:27.534823 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 398/801] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jul 18 10:35:27 2022] GET /compute/v2.1/servers/b1a84290-3520-427e-af49-f380d2a144bb => generated 1724 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:35:27.591058 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-93dc76c2-0fb4-41e5-b646-255bb51ef495 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9eb8d188e040bca894e038955f2402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c656b71bbd447cba7d11335c928dfda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:35:27.599762 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-93dc76c2-0fb4-41e5-b646-255bb51ef495 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] 10.222.0.33 "GET /compute/v2.1/servers/22a03003-3677-426e-8fb8-5b58998eef8a" status: 200 len: 1225 microversion: 2.1 time: 0.104918 Jul 18 10:35:27.609791 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 404/802] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:35:27 2022] GET /compute/v2.1/servers/22a03003-3677-426e-8fb8-5b58998eef8a => generated 1225 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:35:28.552885 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-b1253521-e5e4-4e70-b102-74b6e9d35803 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:35:28.553533 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-b1253521-e5e4-4e70-b102-74b6e9d35803 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] [instance: b1a84290-3520-427e-af49-f380d2a144bb] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:35:28.559983 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-b1253521-e5e4-4e70-b102-74b6e9d35803 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:35:28.560423 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-b1253521-e5e4-4e70-b102-74b6e9d35803 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:35:28.561203 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-b1253521-e5e4-4e70-b102-74b6e9d35803 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:35:28.561627 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-b1253521-e5e4-4e70-b102-74b6e9d35803 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:35:28.616681 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-4d65da29-3b12-4b06-a57d-03f594e2b6d1 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:35:28.617286 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-4d65da29-3b12-4b06-a57d-03f594e2b6d1 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] [instance: 22a03003-3677-426e-8fb8-5b58998eef8a] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:35:28.623861 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-4d65da29-3b12-4b06-a57d-03f594e2b6d1 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:35:28.624334 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-4d65da29-3b12-4b06-a57d-03f594e2b6d1 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:35:28.625471 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-4d65da29-3b12-4b06-a57d-03f594e2b6d1 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:35:28.625966 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-4d65da29-3b12-4b06-a57d-03f594e2b6d1 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:35:28.639795 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.wsgi [None req-4d65da29-3b12-4b06-a57d-03f594e2b6d1 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] HTTP exception thrown: Instance 22a03003-3677-426e-8fb8-5b58998eef8a could not be found. Jul 18 10:35:28.641454 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-4d65da29-3b12-4b06-a57d-03f594e2b6d1 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Request method failure captured: Jul 18 10:35:28.641454 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: request: GET /compute/v2.1/servers/22a03003-3677-426e-8fb8-5b58998eef8a HTTP/1.1 Jul 18 10:35:28.641454 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: Accept: application/json Jul 18 10:35:28.641454 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: Accept-Encoding: identity Jul 18 10:35:28.641454 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: Connection: close Jul 18 10:35:28.641454 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: Content-Length: 0 Jul 18 10:35:28.641454 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: Content-Type: application/json Jul 18 10:35:28.641454 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: Host: 10.222.0.33 Jul 18 10:35:28.641454 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: Openstack-System-Scope: None Jul 18 10:35:28.641454 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: User-Agent: python-urllib3/1.26.9 Jul 18 10:35:28.641454 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Auth-Token: gAAAAABi1Ta7jUVddA4lAkYQOSn5ba4GUqIUnjCcEqF4pQxl-GEznssUVevgvZpkX6wQZnZIi_fUKggUhA3ggfdR-HT6czJuyYKZ7rf0YtZlULyLd1O6aYbOL68zIP4nma5o985FLbJEtPDh_LavK9gjeR0JtBZAYixbhp1H5pGtnwKvIXY--Bw Jul 18 10:35:28.641454 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Domain-Id: None Jul 18 10:35:28.641454 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Domain-Name: None Jul 18 10:35:28.641454 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Identity-Status: Confirmed Jul 18 10:35:28.641454 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Is-Admin-Project: True Jul 18 10:35:28.641454 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Project-Domain-Id: default Jul 18 10:35:28.641454 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Project-Domain-Name: Default Jul 18 10:35:28.641454 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Project-Id: 2c656b71bbd447cba7d11335c928dfda Jul 18 10:35:28.641454 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Project-Name: tempest-TestVolumeBootPattern-248550394 Jul 18 10:35:28.641454 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Role: member,reader Jul 18 10:35:28.641454 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Roles: member,reader Jul 18 10:35:28.643107 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/2c656b71bbd447cba7d11335c928dfda"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/2c656b71bbd447cba7d11335c928dfda"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/2c656b71bbd447cba7d11335c928dfda"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_2c656b71bbd447cba7d11335c928dfda"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jul 18 10:35:28.643107 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Tenant: tempest-TestVolumeBootPattern-248550394 Jul 18 10:35:28.643107 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Tenant-Id: 2c656b71bbd447cba7d11335c928dfda Jul 18 10:35:28.643107 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Tenant-Name: tempest-TestVolumeBootPattern-248550394 Jul 18 10:35:28.643107 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-User: tempest-TestVolumeBootPattern-248550394-project Jul 18 10:35:28.643107 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-User-Domain-Id: default Jul 18 10:35:28.643107 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-User-Domain-Name: Default Jul 18 10:35:28.643107 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-User-Id: 4e9eb8d188e040bca894e038955f2402 Jul 18 10:35:28.643107 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-User-Name: tempest-TestVolumeBootPattern-248550394-project Jul 18 10:35:28.643107 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: method: > Jul 18 10:35:28.643107 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: exception: Instance 22a03003-3677-426e-8fb8-5b58998eef8a could not be found. Jul 18 10:35:28.643107 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: action_args: {'id': '22a03003-3677-426e-8fb8-5b58998eef8a'} Jul 18 10:35:28.644091 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 10:35:28.644091 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:35:28.644091 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 10:35:28.644091 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 10:35:28.644091 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 10:35:28.644091 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 10:35:28.644091 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 10:35:28.644091 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 10:35:28.644091 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 10:35:28.644091 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 10:35:28.644091 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 22a03003-3677-426e-8fb8-5b58998eef8a could not be found. Jul 18 10:35:28.644091 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi Jul 18 10:35:28.644091 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:35:28.644091 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi Jul 18 10:35:28.644091 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:35:28.644091 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:35:28.644091 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:35:28.644091 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 10:35:28.644091 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 10:35:28.644091 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 10:35:28.645722 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 10:35:28.645722 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 10:35:28.645722 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 10:35:28.645722 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 10:35:28.645722 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 10:35:28.645722 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 10:35:28.645722 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 10:35:28.645722 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 22a03003-3677-426e-8fb8-5b58998eef8a could not be found. Jul 18 10:35:28.645722 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi Jul 18 10:35:28.645722 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:35:28.645722 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi Jul 18 10:35:28.645722 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:35:28.645722 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:35:28.645722 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:35:28.645722 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 10:35:28.645722 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 10:35:28.645722 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 22a03003-3677-426e-8fb8-5b58998eef8a could not be found. Jul 18 10:35:28.645722 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi Jul 18 10:35:28.647280 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-4d65da29-3b12-4b06-a57d-03f594e2b6d1 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Returning 404 to user: Instance 22a03003-3677-426e-8fb8-5b58998eef8a could not be found. {{(pid=117879) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 10:35:28.647280 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-4d65da29-3b12-4b06-a57d-03f594e2b6d1 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] 10.222.0.33 "GET /compute/v2.1/servers/22a03003-3677-426e-8fb8-5b58998eef8a" status: 404 len: 111 microversion: 2.1 time: 0.030560 Jul 18 10:35:28.647280 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 405/803] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:35:28 2022] GET /compute/v2.1/servers/22a03003-3677-426e-8fb8-5b58998eef8a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 18 10:35:28.693556 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-b1253521-e5e4-4e70-b102-74b6e9d35803 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:35:28.701305 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-b1253521-e5e4-4e70-b102-74b6e9d35803 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:35:28.702789 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-b1253521-e5e4-4e70-b102-74b6e9d35803 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:35:28.703941 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-b1253521-e5e4-4e70-b102-74b6e9d35803 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] 10.222.0.33 "GET /compute/v2.1/servers/b1a84290-3520-427e-af49-f380d2a144bb" status: 200 len: 1745 microversion: 2.20 time: 0.155496 Jul 18 10:35:28.704489 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 399/804] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jul 18 10:35:28 2022] GET /compute/v2.1/servers/b1a84290-3520-427e-af49-f380d2a144bb => generated 1745 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:35:28.737009 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-aa3b32fc-f3b0-4520-81f3-5170ae55e3d9 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1899556454", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-986614198", "security_groups": [{"name": "tempest-secgroup-smoke-350612805"}], "block_device_mapping_v2": [{"uuid": "fa7171d5-c853-4a34-9f73-34827b083477", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "9e654fce-ea72-45f2-b759-da2c9a65544d"}]}} {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:35:28.844711 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.network.neutron [None req-aa3b32fc-f3b0-4520-81f3-5170ae55e3d9 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] validate_networks() for [('9e654fce-ea72-45f2-b759-da2c9a65544d', None, None, None, None, None)] {{(pid=117879) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 10:35:29.263385 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.virt.hardware [None req-aa3b32fc-f3b0-4520-81f3-5170ae55e3d9 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Flavor limits 0:0:0 {{(pid=117879) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 10:35:29.263842 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.virt.hardware [None req-aa3b32fc-f3b0-4520-81f3-5170ae55e3d9 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Image limits 0:0:0 {{(pid=117879) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 10:35:29.264320 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.virt.hardware [None req-aa3b32fc-f3b0-4520-81f3-5170ae55e3d9 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Flavor pref 0:0:0 {{(pid=117879) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 10:35:29.264764 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.virt.hardware [None req-aa3b32fc-f3b0-4520-81f3-5170ae55e3d9 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Image pref 0:0:0 {{(pid=117879) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 10:35:29.265177 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.virt.hardware [None req-aa3b32fc-f3b0-4520-81f3-5170ae55e3d9 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117879) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 10:35:29.273865 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-aa3b32fc-f3b0-4520-81f3-5170ae55e3d9 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:35:29.274316 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-aa3b32fc-f3b0-4520-81f3-5170ae55e3d9 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:35:29.275140 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-aa3b32fc-f3b0-4520-81f3-5170ae55e3d9 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:35:29.275585 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-aa3b32fc-f3b0-4520-81f3-5170ae55e3d9 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:35:29.291886 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.quota [None req-aa3b32fc-f3b0-4520-81f3-5170ae55e3d9 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Getting quotas for project 2c656b71bbd447cba7d11335c928dfda. Resources: {'ram', 'cores', 'instances'} {{(pid=117879) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 10:35:29.295891 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.quota [None req-aa3b32fc-f3b0-4520-81f3-5170ae55e3d9 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Getting quotas for user 4e9eb8d188e040bca894e038955f2402 and project 2c656b71bbd447cba7d11335c928dfda. Resources: {'ram', 'cores', 'instances'} {{(pid=117879) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 10:35:29.352444 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-aa3b32fc-f3b0-4520-81f3-5170ae55e3d9 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Going to run 1 instances... {{(pid=117879) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 10:35:29.354533 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-aa3b32fc-f3b0-4520-81f3-5170ae55e3d9 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] [instance: 0851efd6-d3b6-44d7-9b22-e327e1bca393] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='fa7171d5-c853-4a34-9f73-34827b083477',volume_size=None,volume_type=None)] {{(pid=117879) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 10:35:29.480094 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-aa3b32fc-f3b0-4520-81f3-5170ae55e3d9 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.746830 Jul 18 10:35:29.480769 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 406/805] 10.222.0.33 () {60 vars in 1146 bytes} [Mon Jul 18 10:35:28 2022] POST /compute/v2.1/servers => generated 405 bytes in 748 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 10:35:29.491209 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-0fdee616-6c70-4a73-af3e-d8ce2d021ff1 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:35:29.491751 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-0fdee616-6c70-4a73-af3e-d8ce2d021ff1 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] [instance: 0851efd6-d3b6-44d7-9b22-e327e1bca393] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:35:29.543119 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-0fdee616-6c70-4a73-af3e-d8ce2d021ff1 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9eb8d188e040bca894e038955f2402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c656b71bbd447cba7d11335c928dfda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:35:29.550834 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-0fdee616-6c70-4a73-af3e-d8ce2d021ff1 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] 10.222.0.33 "GET /compute/v2.1/servers/0851efd6-d3b6-44d7-9b22-e327e1bca393" status: 200 len: 1094 microversion: 2.1 time: 0.063342 Jul 18 10:35:29.551673 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 400/806] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:35:29 2022] GET /compute/v2.1/servers/0851efd6-d3b6-44d7-9b22-e327e1bca393 => generated 1094 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:35:29.725943 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-e9ca075d-33b8-4045-b4b7-4caca954af1b tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:35:29.727892 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-e9ca075d-33b8-4045-b4b7-4caca954af1b tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] [instance: b1a84290-3520-427e-af49-f380d2a144bb] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:35:29.739465 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-e9ca075d-33b8-4045-b4b7-4caca954af1b tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:35:29.739927 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-e9ca075d-33b8-4045-b4b7-4caca954af1b tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:35:29.740846 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-e9ca075d-33b8-4045-b4b7-4caca954af1b tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:35:29.741323 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-e9ca075d-33b8-4045-b4b7-4caca954af1b tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:35:29.913033 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-e9ca075d-33b8-4045-b4b7-4caca954af1b tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:35:29.925852 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-e9ca075d-33b8-4045-b4b7-4caca954af1b tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:35:29.927627 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-e9ca075d-33b8-4045-b4b7-4caca954af1b tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:35:29.929315 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-e9ca075d-33b8-4045-b4b7-4caca954af1b tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] 10.222.0.33 "GET /compute/v2.1/servers/b1a84290-3520-427e-af49-f380d2a144bb" status: 200 len: 1740 microversion: 2.20 time: 0.210476 Jul 18 10:35:29.930478 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 407/807] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jul 18 10:35:29 2022] GET /compute/v2.1/servers/b1a84290-3520-427e-af49-f380d2a144bb => generated 1740 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:35:30.568676 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-e02833dd-36c7-48f5-b4dc-225744fd00b0 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:35:30.569946 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-e02833dd-36c7-48f5-b4dc-225744fd00b0 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] [instance: 0851efd6-d3b6-44d7-9b22-e327e1bca393] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:35:30.576832 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-e02833dd-36c7-48f5-b4dc-225744fd00b0 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:35:30.577533 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-e02833dd-36c7-48f5-b4dc-225744fd00b0 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:35:30.578441 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-e02833dd-36c7-48f5-b4dc-225744fd00b0 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:35:30.578797 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-e02833dd-36c7-48f5-b4dc-225744fd00b0 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:35:30.669284 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-e02833dd-36c7-48f5-b4dc-225744fd00b0 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9eb8d188e040bca894e038955f2402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c656b71bbd447cba7d11335c928dfda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:35:30.677348 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-e02833dd-36c7-48f5-b4dc-225744fd00b0 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] 10.222.0.33 "GET /compute/v2.1/servers/0851efd6-d3b6-44d7-9b22-e327e1bca393" status: 200 len: 1210 microversion: 2.1 time: 0.112972 Jul 18 10:35:30.677913 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 401/808] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:35:30 2022] GET /compute/v2.1/servers/0851efd6-d3b6-44d7-9b22-e327e1bca393 => generated 1210 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:35:30.947649 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-3c8cedfa-eb9c-4260-8add-b06e100f6223 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:35:30.948914 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-3c8cedfa-eb9c-4260-8add-b06e100f6223 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] [instance: b1a84290-3520-427e-af49-f380d2a144bb] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:35:30.955498 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-3c8cedfa-eb9c-4260-8add-b06e100f6223 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:35:30.955943 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-3c8cedfa-eb9c-4260-8add-b06e100f6223 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:35:30.957457 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-3c8cedfa-eb9c-4260-8add-b06e100f6223 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:35:30.958060 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-3c8cedfa-eb9c-4260-8add-b06e100f6223 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:35:31.176977 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-3c8cedfa-eb9c-4260-8add-b06e100f6223 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:35:31.187561 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-3c8cedfa-eb9c-4260-8add-b06e100f6223 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:35:31.189161 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-3c8cedfa-eb9c-4260-8add-b06e100f6223 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:35:31.191101 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-3c8cedfa-eb9c-4260-8add-b06e100f6223 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] 10.222.0.33 "GET /compute/v2.1/servers/b1a84290-3520-427e-af49-f380d2a144bb" status: 200 len: 1740 microversion: 2.20 time: 0.246767 Jul 18 10:35:31.204541 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 408/809] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jul 18 10:35:30 2022] GET /compute/v2.1/servers/b1a84290-3520-427e-af49-f380d2a144bb => generated 1740 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:35:31.694901 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-d43a38fe-f3e2-49bf-912f-7d6c6312ba17 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:35:31.695512 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-d43a38fe-f3e2-49bf-912f-7d6c6312ba17 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] [instance: 0851efd6-d3b6-44d7-9b22-e327e1bca393] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:35:31.706911 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-d43a38fe-f3e2-49bf-912f-7d6c6312ba17 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:35:31.707629 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-d43a38fe-f3e2-49bf-912f-7d6c6312ba17 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:35:31.708638 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-d43a38fe-f3e2-49bf-912f-7d6c6312ba17 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:35:31.709275 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-d43a38fe-f3e2-49bf-912f-7d6c6312ba17 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:35:31.870035 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [req-938faa6d-c86d-414e-90d0-f9ecde04f08d req-fcd4e56e-938c-479b-a063-1aaf7520fe79 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b1a84290-3520-427e-af49-f380d2a144bb", "name": "network-vif-plugged", "status": "completed", "tag": "b5aa065e-e228-4681-909e-bd39389938fd"}]} {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:35:31.890909 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [req-938faa6d-c86d-414e-90d0-f9ecde04f08d req-fcd4e56e-938c-479b-a063-1aaf7520fe79 service nova] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:35:31.891613 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [req-938faa6d-c86d-414e-90d0-f9ecde04f08d req-fcd4e56e-938c-479b-a063-1aaf7520fe79 service nova] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:35:31.915863 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.compute.server_external_events [req-938faa6d-c86d-414e-90d0-f9ecde04f08d req-fcd4e56e-938c-479b-a063-1aaf7520fe79 service nova] Creating event network-vif-plugged:b5aa065e-e228-4681-909e-bd39389938fd for instance b1a84290-3520-427e-af49-f380d2a144bb on hv-cinder-83754 Jul 18 10:35:31.939752 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [req-938faa6d-c86d-414e-90d0-f9ecde04f08d req-fcd4e56e-938c-479b-a063-1aaf7520fe79 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072916 Jul 18 10:35:31.941383 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 409/810] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jul 18 10:35:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:35:31.969354 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-d43a38fe-f3e2-49bf-912f-7d6c6312ba17 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9eb8d188e040bca894e038955f2402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c656b71bbd447cba7d11335c928dfda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:35:31.977650 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-d43a38fe-f3e2-49bf-912f-7d6c6312ba17 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] 10.222.0.33 "GET /compute/v2.1/servers/0851efd6-d3b6-44d7-9b22-e327e1bca393" status: 200 len: 1277 microversion: 2.1 time: 0.287022 Jul 18 10:35:32.000616 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 402/811] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:35:31 2022] GET /compute/v2.1/servers/0851efd6-d3b6-44d7-9b22-e327e1bca393 => generated 1277 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:35:32.211560 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-19a4c465-66b8-4b48-94b8-7a1b26b696c2 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:35:32.213845 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-19a4c465-66b8-4b48-94b8-7a1b26b696c2 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] [instance: b1a84290-3520-427e-af49-f380d2a144bb] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:35:32.221029 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-19a4c465-66b8-4b48-94b8-7a1b26b696c2 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:35:32.222305 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-19a4c465-66b8-4b48-94b8-7a1b26b696c2 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:35:32.223529 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-19a4c465-66b8-4b48-94b8-7a1b26b696c2 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:35:32.223976 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-19a4c465-66b8-4b48-94b8-7a1b26b696c2 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:35:32.499726 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-19a4c465-66b8-4b48-94b8-7a1b26b696c2 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:35:32.511260 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-19a4c465-66b8-4b48-94b8-7a1b26b696c2 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:35:32.512988 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-19a4c465-66b8-4b48-94b8-7a1b26b696c2 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:35:32.514277 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-19a4c465-66b8-4b48-94b8-7a1b26b696c2 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] 10.222.0.33 "GET /compute/v2.1/servers/b1a84290-3520-427e-af49-f380d2a144bb" status: 200 len: 1740 microversion: 2.20 time: 0.308843 Jul 18 10:35:32.525929 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 410/812] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jul 18 10:35:32 2022] GET /compute/v2.1/servers/b1a84290-3520-427e-af49-f380d2a144bb => generated 1740 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:35:32.572231 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-2818ac18-9174-4790-90e0-acbc4a1d1772 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:35:32.573256 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-2818ac18-9174-4790-90e0-acbc4a1d1772 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] [instance: 72245495-f5b8-4f54-8d17-ec3e700bdd9b] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:35:32.574680 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG dbcounter [-] [117880] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=117880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:35:32.585465 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-2818ac18-9174-4790-90e0-acbc4a1d1772 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:35:32.589293 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-2818ac18-9174-4790-90e0-acbc4a1d1772 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:35:32.590677 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-2818ac18-9174-4790-90e0-acbc4a1d1772 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:35:32.591327 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-2818ac18-9174-4790-90e0-acbc4a1d1772 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:35:32.736172 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.objects.instance [None req-2818ac18-9174-4790-90e0-acbc4a1d1772 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lazy-loading 'services' on Instance uuid 72245495-f5b8-4f54-8d17-ec3e700bdd9b {{(pid=117880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 10:35:32.890388 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-2818ac18-9174-4790-90e0-acbc4a1d1772 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] 10.222.0.33 "DELETE /compute/v2.1/servers/72245495-f5b8-4f54-8d17-ec3e700bdd9b/os-volume_attachments/d84e3059-632c-48fb-93be-fa036aa65e2f" status: 202 len: 0 microversion: 2.1 time: 0.322100 Jul 18 10:35:32.894206 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [req-74c16a60-ba03-4bdf-9039-54dabe8e20ab req-9c59cc11-63c2-4838-96f1-deaec4e84558 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0851efd6-d3b6-44d7-9b22-e327e1bca393", "tag": "ef589bb7-916e-48f9-bce4-fdf64f4ed1b1"}]} {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:35:32.900921 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 403/813] 10.222.0.33 () {58 vars in 1415 bytes} [Mon Jul 18 10:35:32 2022] DELETE /compute/v2.1/servers/72245495-f5b8-4f54-8d17-ec3e700bdd9b/os-volume_attachments/d84e3059-632c-48fb-93be-fa036aa65e2f => generated 0 bytes in 333 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 10:35:32.929865 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-1f34e87e-3b3d-43eb-bdc1-5e67709b669a tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:35:32.932370 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-1f34e87e-3b3d-43eb-bdc1-5e67709b669a tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] [instance: 72245495-f5b8-4f54-8d17-ec3e700bdd9b] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:35:32.936258 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG dbcounter [-] [117879] Writing DB stats nova_api:SELECT=72,nova_api:INSERT=3 {{(pid=117879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:35:32.943093 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [req-74c16a60-ba03-4bdf-9039-54dabe8e20ab req-9c59cc11-63c2-4838-96f1-deaec4e84558 service nova] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:35:32.944680 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [req-74c16a60-ba03-4bdf-9039-54dabe8e20ab req-9c59cc11-63c2-4838-96f1-deaec4e84558 service nova] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:35:32.955547 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-1f34e87e-3b3d-43eb-bdc1-5e67709b669a tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:35:32.957702 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-1f34e87e-3b3d-43eb-bdc1-5e67709b669a tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:35:32.958925 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-1f34e87e-3b3d-43eb-bdc1-5e67709b669a tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:35:32.959485 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-1f34e87e-3b3d-43eb-bdc1-5e67709b669a tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:35:32.966857 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.compute.server_external_events [req-74c16a60-ba03-4bdf-9039-54dabe8e20ab req-9c59cc11-63c2-4838-96f1-deaec4e84558 service nova] Creating event network-changed:ef589bb7-916e-48f9-bce4-fdf64f4ed1b1 for instance 0851efd6-d3b6-44d7-9b22-e327e1bca393 on hv-cinder-83754 Jul 18 10:35:32.973281 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [req-74c16a60-ba03-4bdf-9039-54dabe8e20ab req-9c59cc11-63c2-4838-96f1-deaec4e84558 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086847 Jul 18 10:35:32.974548 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 411/814] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jul 18 10:35:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:35:32.988267 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG dbcounter [-] [117880] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=1,nova_cell1:INSERT=3 {{(pid=117880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:35:33.024005 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-737ce514-b77b-4dce-8eaf-729de2d9881a tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:35:33.032167 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-737ce514-b77b-4dce-8eaf-729de2d9881a tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] [instance: 0851efd6-d3b6-44d7-9b22-e327e1bca393] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:35:33.035225 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-1f34e87e-3b3d-43eb-bdc1-5e67709b669a tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] 10.222.0.33 "GET /compute/v2.1/servers/72245495-f5b8-4f54-8d17-ec3e700bdd9b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.116798 Jul 18 10:35:33.036814 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 404/815] 10.222.0.33 () {58 vars in 1301 bytes} [Mon Jul 18 10:35:32 2022] GET /compute/v2.1/servers/72245495-f5b8-4f54-8d17-ec3e700bdd9b/os-volume_attachments => generated 197 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:35:33.053994 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-737ce514-b77b-4dce-8eaf-729de2d9881a tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:35:33.057613 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-737ce514-b77b-4dce-8eaf-729de2d9881a tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:35:33.061078 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-737ce514-b77b-4dce-8eaf-729de2d9881a tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:35:33.062652 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-737ce514-b77b-4dce-8eaf-729de2d9881a tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:35:33.397930 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-737ce514-b77b-4dce-8eaf-729de2d9881a tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9eb8d188e040bca894e038955f2402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c656b71bbd447cba7d11335c928dfda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:35:33.406672 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-737ce514-b77b-4dce-8eaf-729de2d9881a tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] 10.222.0.33 "GET /compute/v2.1/servers/0851efd6-d3b6-44d7-9b22-e327e1bca393" status: 200 len: 1277 microversion: 2.1 time: 0.400701 Jul 18 10:35:33.407545 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 412/816] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:35:32 2022] GET /compute/v2.1/servers/0851efd6-d3b6-44d7-9b22-e327e1bca393 => generated 1277 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:35:33.533385 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-e19a6a71-76ff-48d8-a1b3-53e1c0731ee7 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:35:33.534186 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-e19a6a71-76ff-48d8-a1b3-53e1c0731ee7 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] [instance: b1a84290-3520-427e-af49-f380d2a144bb] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:35:33.542677 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-e19a6a71-76ff-48d8-a1b3-53e1c0731ee7 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:35:33.543336 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-e19a6a71-76ff-48d8-a1b3-53e1c0731ee7 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:35:33.544333 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-e19a6a71-76ff-48d8-a1b3-53e1c0731ee7 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:35:33.545114 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-e19a6a71-76ff-48d8-a1b3-53e1c0731ee7 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:35:33.711713 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-2101f018-4dee-4a0b-9b33-5154bdd67c8d tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:35:33.712532 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-2101f018-4dee-4a0b-9b33-5154bdd67c8d tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] [instance: 9cdd676f-7b24-4c7e-849c-97e196465a3c] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:35:33.728333 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-2101f018-4dee-4a0b-9b33-5154bdd67c8d tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:35:33.728818 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-2101f018-4dee-4a0b-9b33-5154bdd67c8d tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:35:33.729603 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-2101f018-4dee-4a0b-9b33-5154bdd67c8d tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:35:33.730115 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-2101f018-4dee-4a0b-9b33-5154bdd67c8d tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:35:33.767335 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-2101f018-4dee-4a0b-9b33-5154bdd67c8d tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] 10.222.0.33 "GET /compute/v2.1/servers/9cdd676f-7b24-4c7e-849c-97e196465a3c/os-volume_attachments/80694cf1-1957-459f-a90c-e9223d94c284" status: 200 len: 194 microversion: 2.1 time: 0.059786 Jul 18 10:35:33.768354 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 413/817] 10.222.0.33 () {58 vars in 1412 bytes} [Mon Jul 18 10:35:33 2022] GET /compute/v2.1/servers/9cdd676f-7b24-4c7e-849c-97e196465a3c/os-volume_attachments/80694cf1-1957-459f-a90c-e9223d94c284 => generated 194 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 10:35:33.788965 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-6dbd196a-643d-4f9a-a681-21f97a111bb9 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:35:33.789362 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-6dbd196a-643d-4f9a-a681-21f97a111bb9 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] [instance: 9cdd676f-7b24-4c7e-849c-97e196465a3c] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:35:33.796810 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-6dbd196a-643d-4f9a-a681-21f97a111bb9 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:35:33.797271 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-6dbd196a-643d-4f9a-a681-21f97a111bb9 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:35:33.801473 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-6dbd196a-643d-4f9a-a681-21f97a111bb9 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:35:33.802219 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-6dbd196a-643d-4f9a-a681-21f97a111bb9 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:35:33.852292 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-e19a6a71-76ff-48d8-a1b3-53e1c0731ee7 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:35:33.866686 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-e19a6a71-76ff-48d8-a1b3-53e1c0731ee7 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:35:33.868419 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-e19a6a71-76ff-48d8-a1b3-53e1c0731ee7 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:35:33.875889 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-e19a6a71-76ff-48d8-a1b3-53e1c0731ee7 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] 10.222.0.33 "GET /compute/v2.1/servers/b1a84290-3520-427e-af49-f380d2a144bb" status: 200 len: 1740 microversion: 2.20 time: 0.346712 Jul 18 10:35:33.876937 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 405/818] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jul 18 10:35:33 2022] GET /compute/v2.1/servers/b1a84290-3520-427e-af49-f380d2a144bb => generated 1740 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:35:33.929810 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.objects.instance [None req-6dbd196a-643d-4f9a-a681-21f97a111bb9 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lazy-loading 'services' on Instance uuid 9cdd676f-7b24-4c7e-849c-97e196465a3c {{(pid=117879) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 10:35:34.018098 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-6dbd196a-643d-4f9a-a681-21f97a111bb9 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] 10.222.0.33 "DELETE /compute/v2.1/servers/9cdd676f-7b24-4c7e-849c-97e196465a3c/os-volume_attachments/80694cf1-1957-459f-a90c-e9223d94c284" status: 202 len: 0 microversion: 2.1 time: 0.242946 Jul 18 10:35:34.019611 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 414/819] 10.222.0.33 () {58 vars in 1415 bytes} [Mon Jul 18 10:35:33 2022] DELETE /compute/v2.1/servers/9cdd676f-7b24-4c7e-849c-97e196465a3c/os-volume_attachments/80694cf1-1957-459f-a90c-e9223d94c284 => generated 0 bytes in 245 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 10:35:34.048205 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-3a91b5c7-e63c-4d49-a7ec-c3a17dcd57d9 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:35:34.049247 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-3a91b5c7-e63c-4d49-a7ec-c3a17dcd57d9 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] [instance: 72245495-f5b8-4f54-8d17-ec3e700bdd9b] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:35:34.056101 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-3a91b5c7-e63c-4d49-a7ec-c3a17dcd57d9 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:35:34.056586 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-3a91b5c7-e63c-4d49-a7ec-c3a17dcd57d9 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:35:34.057368 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-3a91b5c7-e63c-4d49-a7ec-c3a17dcd57d9 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:35:34.057806 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-3a91b5c7-e63c-4d49-a7ec-c3a17dcd57d9 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:35:34.091754 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-3a91b5c7-e63c-4d49-a7ec-c3a17dcd57d9 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] 10.222.0.33 "GET /compute/v2.1/servers/72245495-f5b8-4f54-8d17-ec3e700bdd9b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047533 Jul 18 10:35:34.092969 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 406/820] 10.222.0.33 () {58 vars in 1301 bytes} [Mon Jul 18 10:35:34 2022] GET /compute/v2.1/servers/72245495-f5b8-4f54-8d17-ec3e700bdd9b/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:35:34.428521 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-549b7117-4a3b-4950-b2a4-d0d8db0279e6 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:35:34.429228 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-549b7117-4a3b-4950-b2a4-d0d8db0279e6 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] [instance: 0851efd6-d3b6-44d7-9b22-e327e1bca393] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:35:34.435956 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-549b7117-4a3b-4950-b2a4-d0d8db0279e6 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:35:34.436381 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-549b7117-4a3b-4950-b2a4-d0d8db0279e6 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:35:34.437494 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-549b7117-4a3b-4950-b2a4-d0d8db0279e6 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:35:34.438195 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-549b7117-4a3b-4950-b2a4-d0d8db0279e6 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:35:34.630794 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-549b7117-4a3b-4950-b2a4-d0d8db0279e6 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9eb8d188e040bca894e038955f2402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c656b71bbd447cba7d11335c928dfda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:35:34.639057 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-549b7117-4a3b-4950-b2a4-d0d8db0279e6 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] 10.222.0.33 "GET /compute/v2.1/servers/0851efd6-d3b6-44d7-9b22-e327e1bca393" status: 200 len: 1265 microversion: 2.1 time: 0.215533 Jul 18 10:35:34.639710 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 415/821] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:35:34 2022] GET /compute/v2.1/servers/0851efd6-d3b6-44d7-9b22-e327e1bca393 => generated 1265 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:35:34.904533 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-e610ed3a-1200-40dd-91e4-dd2f126c7540 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:35:34.905156 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-e610ed3a-1200-40dd-91e4-dd2f126c7540 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] [instance: b1a84290-3520-427e-af49-f380d2a144bb] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:35:34.913187 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-e610ed3a-1200-40dd-91e4-dd2f126c7540 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:35:34.913957 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-e610ed3a-1200-40dd-91e4-dd2f126c7540 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:35:34.914728 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-e610ed3a-1200-40dd-91e4-dd2f126c7540 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:35:34.915171 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-e610ed3a-1200-40dd-91e4-dd2f126c7540 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:35:35.076707 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-e610ed3a-1200-40dd-91e4-dd2f126c7540 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:35:35.086132 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-e610ed3a-1200-40dd-91e4-dd2f126c7540 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:35:35.087869 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-e610ed3a-1200-40dd-91e4-dd2f126c7540 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:35:35.090412 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-e610ed3a-1200-40dd-91e4-dd2f126c7540 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] 10.222.0.33 "GET /compute/v2.1/servers/b1a84290-3520-427e-af49-f380d2a144bb" status: 200 len: 1740 microversion: 2.20 time: 0.196811 Jul 18 10:35:35.091014 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 407/822] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jul 18 10:35:34 2022] GET /compute/v2.1/servers/b1a84290-3520-427e-af49-f380d2a144bb => generated 1740 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:35:35.106329 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-9a671e00-5a5d-458c-9a0f-b80c06cf6f61 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:35:35.107326 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-9a671e00-5a5d-458c-9a0f-b80c06cf6f61 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] [instance: 72245495-f5b8-4f54-8d17-ec3e700bdd9b] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:35:35.113876 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-9a671e00-5a5d-458c-9a0f-b80c06cf6f61 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:35:35.114541 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-9a671e00-5a5d-458c-9a0f-b80c06cf6f61 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:35:35.115759 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-9a671e00-5a5d-458c-9a0f-b80c06cf6f61 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:35:35.116370 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-9a671e00-5a5d-458c-9a0f-b80c06cf6f61 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:35:35.164011 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-9a671e00-5a5d-458c-9a0f-b80c06cf6f61 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] 10.222.0.33 "GET /compute/v2.1/servers/72245495-f5b8-4f54-8d17-ec3e700bdd9b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058160 Jul 18 10:35:35.165166 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 416/823] 10.222.0.33 () {58 vars in 1301 bytes} [Mon Jul 18 10:35:35 2022] GET /compute/v2.1/servers/72245495-f5b8-4f54-8d17-ec3e700bdd9b/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:35:35.659439 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-4d7c61b4-30ed-4a67-9d0f-2e91200e71b2 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:35:35.660524 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-4d7c61b4-30ed-4a67-9d0f-2e91200e71b2 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] [instance: 0851efd6-d3b6-44d7-9b22-e327e1bca393] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:35:35.667415 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-4d7c61b4-30ed-4a67-9d0f-2e91200e71b2 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:35:35.668360 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-4d7c61b4-30ed-4a67-9d0f-2e91200e71b2 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:35:35.669344 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-4d7c61b4-30ed-4a67-9d0f-2e91200e71b2 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:35:35.670207 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-4d7c61b4-30ed-4a67-9d0f-2e91200e71b2 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:35:35.823491 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-4d7c61b4-30ed-4a67-9d0f-2e91200e71b2 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9eb8d188e040bca894e038955f2402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c656b71bbd447cba7d11335c928dfda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:35:35.832289 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-4d7c61b4-30ed-4a67-9d0f-2e91200e71b2 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] 10.222.0.33 "GET /compute/v2.1/servers/0851efd6-d3b6-44d7-9b22-e327e1bca393" status: 200 len: 1265 microversion: 2.1 time: 0.178969 Jul 18 10:35:35.833205 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 408/824] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:35:35 2022] GET /compute/v2.1/servers/0851efd6-d3b6-44d7-9b22-e327e1bca393 => generated 1265 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:35:36.108299 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-6a0940e4-be94-4d17-ac79-b0b097d5d8f1 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:35:36.109763 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-6a0940e4-be94-4d17-ac79-b0b097d5d8f1 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] [instance: b1a84290-3520-427e-af49-f380d2a144bb] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:35:36.117058 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-6a0940e4-be94-4d17-ac79-b0b097d5d8f1 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:35:36.117512 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-6a0940e4-be94-4d17-ac79-b0b097d5d8f1 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:35:36.118293 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-6a0940e4-be94-4d17-ac79-b0b097d5d8f1 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:35:36.118733 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-6a0940e4-be94-4d17-ac79-b0b097d5d8f1 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:35:36.180629 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-670204ac-da90-44c2-850b-0489deb5b849 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:35:36.182338 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-670204ac-da90-44c2-850b-0489deb5b849 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] [instance: 72245495-f5b8-4f54-8d17-ec3e700bdd9b] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:35:36.190241 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-670204ac-da90-44c2-850b-0489deb5b849 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:35:36.191062 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-670204ac-da90-44c2-850b-0489deb5b849 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:35:36.192106 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-670204ac-da90-44c2-850b-0489deb5b849 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:35:36.192799 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-670204ac-da90-44c2-850b-0489deb5b849 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:35:36.232809 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-670204ac-da90-44c2-850b-0489deb5b849 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] 10.222.0.33 "GET /compute/v2.1/servers/72245495-f5b8-4f54-8d17-ec3e700bdd9b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.061185 Jul 18 10:35:36.233619 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 409/825] 10.222.0.33 () {58 vars in 1301 bytes} [Mon Jul 18 10:35:36 2022] GET /compute/v2.1/servers/72245495-f5b8-4f54-8d17-ec3e700bdd9b/os-volume_attachments => generated 25 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 18 10:35:36.303337 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-6a0940e4-be94-4d17-ac79-b0b097d5d8f1 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:35:36.321621 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-6a0940e4-be94-4d17-ac79-b0b097d5d8f1 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:35:36.323896 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-6a0940e4-be94-4d17-ac79-b0b097d5d8f1 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:35:36.325527 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-6a0940e4-be94-4d17-ac79-b0b097d5d8f1 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] 10.222.0.33 "GET /compute/v2.1/servers/b1a84290-3520-427e-af49-f380d2a144bb" status: 200 len: 1740 microversion: 2.20 time: 0.221026 Jul 18 10:35:36.326350 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 417/826] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jul 18 10:35:36 2022] GET /compute/v2.1/servers/b1a84290-3520-427e-af49-f380d2a144bb => generated 1740 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:35:36.338950 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-21ae01f0-555c-40e8-9f45-d46f5b1bbc8a tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:35:36.339460 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-21ae01f0-555c-40e8-9f45-d46f5b1bbc8a tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] [instance: 72245495-f5b8-4f54-8d17-ec3e700bdd9b] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:35:36.348679 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-21ae01f0-555c-40e8-9f45-d46f5b1bbc8a tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:35:36.349129 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-21ae01f0-555c-40e8-9f45-d46f5b1bbc8a tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:35:36.349904 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-21ae01f0-555c-40e8-9f45-d46f5b1bbc8a tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:35:36.350338 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-21ae01f0-555c-40e8-9f45-d46f5b1bbc8a tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:35:36.385300 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-21ae01f0-555c-40e8-9f45-d46f5b1bbc8a tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] [instance: 72245495-f5b8-4f54-8d17-ec3e700bdd9b] Going to try to terminate instance {{(pid=117880) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 10:35:36.404036 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-6559f525-38e6-4976-b423-d3193b2af335 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:35:36.406807 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-6559f525-38e6-4976-b423-d3193b2af335 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] [instance: 9cdd676f-7b24-4c7e-849c-97e196465a3c] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:35:36.414165 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-6559f525-38e6-4976-b423-d3193b2af335 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:35:36.415034 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-6559f525-38e6-4976-b423-d3193b2af335 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:35:36.416115 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-6559f525-38e6-4976-b423-d3193b2af335 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:35:36.416816 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-6559f525-38e6-4976-b423-d3193b2af335 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:35:36.422778 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG dbcounter [-] [117879] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=117879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:35:36.449466 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-6559f525-38e6-4976-b423-d3193b2af335 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] 10.222.0.33 "GET /compute/v2.1/servers/9cdd676f-7b24-4c7e-849c-97e196465a3c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050513 Jul 18 10:35:36.450376 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 418/827] 10.222.0.33 () {58 vars in 1301 bytes} [Mon Jul 18 10:35:36 2022] GET /compute/v2.1/servers/9cdd676f-7b24-4c7e-849c-97e196465a3c/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 18 10:35:36.493072 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-21ae01f0-555c-40e8-9f45-d46f5b1bbc8a tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] 10.222.0.33 "DELETE /compute/v2.1/servers/72245495-f5b8-4f54-8d17-ec3e700bdd9b" status: 204 len: 0 microversion: 2.1 time: 0.157859 Jul 18 10:35:36.494376 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 410/828] 10.222.0.33 () {58 vars in 1238 bytes} [Mon Jul 18 10:35:36 2022] DELETE /compute/v2.1/servers/72245495-f5b8-4f54-8d17-ec3e700bdd9b => generated 0 bytes in 160 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 10:35:36.505375 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-baae4af8-e45a-46ad-8bc6-01bf4223b79b tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:35:36.506752 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-baae4af8-e45a-46ad-8bc6-01bf4223b79b tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] [instance: 72245495-f5b8-4f54-8d17-ec3e700bdd9b] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:35:36.519404 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-baae4af8-e45a-46ad-8bc6-01bf4223b79b tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:35:36.520206 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-baae4af8-e45a-46ad-8bc6-01bf4223b79b tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:35:36.521317 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-baae4af8-e45a-46ad-8bc6-01bf4223b79b tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:35:36.522092 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-baae4af8-e45a-46ad-8bc6-01bf4223b79b tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:35:36.602906 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-3748e4aa-207a-406e-9326-46cb2d841d97 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:35:36.604418 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-3748e4aa-207a-406e-9326-46cb2d841d97 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] [instance: 9cdd676f-7b24-4c7e-849c-97e196465a3c] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:35:36.619939 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-3748e4aa-207a-406e-9326-46cb2d841d97 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:35:36.620392 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-3748e4aa-207a-406e-9326-46cb2d841d97 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:35:36.621206 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-3748e4aa-207a-406e-9326-46cb2d841d97 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:35:36.621644 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-3748e4aa-207a-406e-9326-46cb2d841d97 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:35:36.667490 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-3748e4aa-207a-406e-9326-46cb2d841d97 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] 10.222.0.33 "GET /compute/v2.1/servers/9cdd676f-7b24-4c7e-849c-97e196465a3c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.070843 Jul 18 10:35:36.672803 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 411/829] 10.222.0.33 () {58 vars in 1301 bytes} [Mon Jul 18 10:35:36 2022] GET /compute/v2.1/servers/9cdd676f-7b24-4c7e-849c-97e196465a3c/os-volume_attachments => generated 25 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 18 10:35:36.716920 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-baae4af8-e45a-46ad-8bc6-01bf4223b79b tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f25c72896a2d4d619e5ad4b5a0a79aa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cf3d5bfe9a745f38372c42c9cfa1f63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:35:36.725699 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-baae4af8-e45a-46ad-8bc6-01bf4223b79b tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] 10.222.0.33 "GET /compute/v2.1/servers/72245495-f5b8-4f54-8d17-ec3e700bdd9b" status: 200 len: 1683 microversion: 2.1 time: 0.226584 Jul 18 10:35:36.726277 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 419/830] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:35:36 2022] GET /compute/v2.1/servers/72245495-f5b8-4f54-8d17-ec3e700bdd9b => generated 1683 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:35:36.774056 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-34f128b1-e446-4c1b-8c6b-6643f9963b86 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:35:36.774653 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-34f128b1-e446-4c1b-8c6b-6643f9963b86 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] [instance: 9cdd676f-7b24-4c7e-849c-97e196465a3c] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:35:36.781597 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-34f128b1-e446-4c1b-8c6b-6643f9963b86 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:35:36.782097 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-34f128b1-e446-4c1b-8c6b-6643f9963b86 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:35:36.783908 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-34f128b1-e446-4c1b-8c6b-6643f9963b86 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:35:36.784772 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-34f128b1-e446-4c1b-8c6b-6643f9963b86 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:35:36.819513 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-34f128b1-e446-4c1b-8c6b-6643f9963b86 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] [instance: 9cdd676f-7b24-4c7e-849c-97e196465a3c] Going to try to terminate instance {{(pid=117880) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 10:35:36.850041 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-805807cb-c148-4738-9ae5-4ea319a58b36 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:35:36.850648 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-805807cb-c148-4738-9ae5-4ea319a58b36 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] [instance: 0851efd6-d3b6-44d7-9b22-e327e1bca393] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:35:36.860453 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-805807cb-c148-4738-9ae5-4ea319a58b36 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:35:36.861317 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-805807cb-c148-4738-9ae5-4ea319a58b36 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:35:36.864056 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-805807cb-c148-4738-9ae5-4ea319a58b36 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:35:36.864826 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-805807cb-c148-4738-9ae5-4ea319a58b36 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:35:36.909533 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-34f128b1-e446-4c1b-8c6b-6643f9963b86 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] 10.222.0.33 "DELETE /compute/v2.1/servers/9cdd676f-7b24-4c7e-849c-97e196465a3c" status: 204 len: 0 microversion: 2.1 time: 0.145838 Jul 18 10:35:36.910575 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 412/831] 10.222.0.33 () {58 vars in 1238 bytes} [Mon Jul 18 10:35:36 2022] DELETE /compute/v2.1/servers/9cdd676f-7b24-4c7e-849c-97e196465a3c => generated 0 bytes in 148 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 10:35:36.921472 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-e715e6f8-eaff-412f-97be-d558380012d9 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:35:36.923972 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-e715e6f8-eaff-412f-97be-d558380012d9 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] [instance: 9cdd676f-7b24-4c7e-849c-97e196465a3c] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:35:36.935751 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-e715e6f8-eaff-412f-97be-d558380012d9 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:35:36.936213 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-e715e6f8-eaff-412f-97be-d558380012d9 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:35:36.937034 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-e715e6f8-eaff-412f-97be-d558380012d9 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:35:36.937475 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-e715e6f8-eaff-412f-97be-d558380012d9 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:35:37.092759 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-805807cb-c148-4738-9ae5-4ea319a58b36 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9eb8d188e040bca894e038955f2402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c656b71bbd447cba7d11335c928dfda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:35:37.101370 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-805807cb-c148-4738-9ae5-4ea319a58b36 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] 10.222.0.33 "GET /compute/v2.1/servers/0851efd6-d3b6-44d7-9b22-e327e1bca393" status: 200 len: 1265 microversion: 2.1 time: 0.255981 Jul 18 10:35:37.103488 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 420/832] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:35:36 2022] GET /compute/v2.1/servers/0851efd6-d3b6-44d7-9b22-e327e1bca393 => generated 1265 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:35:37.130316 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-e715e6f8-eaff-412f-97be-d558380012d9 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '986f90dfbad14324b3fffbd790d60a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e487deb7ff45bdbf2cc002d42d12a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:35:37.138623 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-e715e6f8-eaff-412f-97be-d558380012d9 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] 10.222.0.33 "GET /compute/v2.1/servers/9cdd676f-7b24-4c7e-849c-97e196465a3c" status: 200 len: 1671 microversion: 2.1 time: 0.223487 Jul 18 10:35:37.139202 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 413/833] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:35:36 2022] GET /compute/v2.1/servers/9cdd676f-7b24-4c7e-849c-97e196465a3c => generated 1671 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:35:37.344791 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-117b8790-ddc2-499b-ba9a-83bc792c7d09 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:35:37.346185 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-117b8790-ddc2-499b-ba9a-83bc792c7d09 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] [instance: b1a84290-3520-427e-af49-f380d2a144bb] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:35:37.355054 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-117b8790-ddc2-499b-ba9a-83bc792c7d09 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:35:37.356298 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-117b8790-ddc2-499b-ba9a-83bc792c7d09 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:35:37.357503 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-117b8790-ddc2-499b-ba9a-83bc792c7d09 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:35:37.357940 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-117b8790-ddc2-499b-ba9a-83bc792c7d09 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:35:37.506141 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-117b8790-ddc2-499b-ba9a-83bc792c7d09 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:35:37.514698 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-117b8790-ddc2-499b-ba9a-83bc792c7d09 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:35:37.516256 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-117b8790-ddc2-499b-ba9a-83bc792c7d09 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:35:37.517458 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-117b8790-ddc2-499b-ba9a-83bc792c7d09 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] 10.222.0.33 "GET /compute/v2.1/servers/b1a84290-3520-427e-af49-f380d2a144bb" status: 200 len: 1740 microversion: 2.20 time: 0.176620 Jul 18 10:35:37.529208 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 421/834] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jul 18 10:35:37 2022] GET /compute/v2.1/servers/b1a84290-3520-427e-af49-f380d2a144bb => generated 1740 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:35:37.743346 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-4e820a6c-84ec-47ea-a6be-5659d7531cbf tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:35:37.744066 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-4e820a6c-84ec-47ea-a6be-5659d7531cbf tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] [instance: 72245495-f5b8-4f54-8d17-ec3e700bdd9b] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:35:37.751939 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-4e820a6c-84ec-47ea-a6be-5659d7531cbf tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:35:37.752403 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-4e820a6c-84ec-47ea-a6be-5659d7531cbf tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:35:37.753438 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-4e820a6c-84ec-47ea-a6be-5659d7531cbf tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:35:37.753843 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-4e820a6c-84ec-47ea-a6be-5659d7531cbf tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:35:37.922193 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-4e820a6c-84ec-47ea-a6be-5659d7531cbf tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f25c72896a2d4d619e5ad4b5a0a79aa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cf3d5bfe9a745f38372c42c9cfa1f63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:35:37.937364 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-4e820a6c-84ec-47ea-a6be-5659d7531cbf tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] 10.222.0.33 "GET /compute/v2.1/servers/72245495-f5b8-4f54-8d17-ec3e700bdd9b" status: 200 len: 1683 microversion: 2.1 time: 0.197561 Jul 18 10:35:37.938491 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 414/835] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:35:37 2022] GET /compute/v2.1/servers/72245495-f5b8-4f54-8d17-ec3e700bdd9b => generated 1683 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:35:38.118920 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-df6996a4-7723-42de-b6d6-19acd026b3b5 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:35:38.119957 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-df6996a4-7723-42de-b6d6-19acd026b3b5 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] [instance: 0851efd6-d3b6-44d7-9b22-e327e1bca393] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:35:38.126997 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-df6996a4-7723-42de-b6d6-19acd026b3b5 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:35:38.127566 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-df6996a4-7723-42de-b6d6-19acd026b3b5 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:35:38.129040 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-df6996a4-7723-42de-b6d6-19acd026b3b5 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:35:38.129777 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-df6996a4-7723-42de-b6d6-19acd026b3b5 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:35:38.168824 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-07ef2caf-d44b-434f-8fb1-402857f6b952 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:35:38.170444 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-07ef2caf-d44b-434f-8fb1-402857f6b952 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] [instance: 9cdd676f-7b24-4c7e-849c-97e196465a3c] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:35:38.199324 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-07ef2caf-d44b-434f-8fb1-402857f6b952 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:35:38.200916 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-07ef2caf-d44b-434f-8fb1-402857f6b952 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:35:38.202164 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-07ef2caf-d44b-434f-8fb1-402857f6b952 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:35:38.203580 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-07ef2caf-d44b-434f-8fb1-402857f6b952 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:35:38.343515 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-df6996a4-7723-42de-b6d6-19acd026b3b5 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9eb8d188e040bca894e038955f2402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c656b71bbd447cba7d11335c928dfda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:35:38.356307 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-df6996a4-7723-42de-b6d6-19acd026b3b5 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] 10.222.0.33 "GET /compute/v2.1/servers/0851efd6-d3b6-44d7-9b22-e327e1bca393" status: 200 len: 1265 microversion: 2.1 time: 0.241258 Jul 18 10:35:38.358128 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 422/836] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:35:38 2022] GET /compute/v2.1/servers/0851efd6-d3b6-44d7-9b22-e327e1bca393 => generated 1265 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:35:38.390206 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-07ef2caf-d44b-434f-8fb1-402857f6b952 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '986f90dfbad14324b3fffbd790d60a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e487deb7ff45bdbf2cc002d42d12a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:35:38.397998 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-07ef2caf-d44b-434f-8fb1-402857f6b952 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] 10.222.0.33 "GET /compute/v2.1/servers/9cdd676f-7b24-4c7e-849c-97e196465a3c" status: 200 len: 1671 microversion: 2.1 time: 0.246535 Jul 18 10:35:38.398735 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 415/837] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:35:38 2022] GET /compute/v2.1/servers/9cdd676f-7b24-4c7e-849c-97e196465a3c => generated 1671 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:35:38.535463 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-905a6064-91ec-4817-910e-72c8d27e5a71 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:35:38.536066 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-905a6064-91ec-4817-910e-72c8d27e5a71 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] [instance: b1a84290-3520-427e-af49-f380d2a144bb] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:35:38.545044 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-905a6064-91ec-4817-910e-72c8d27e5a71 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:35:38.545864 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-905a6064-91ec-4817-910e-72c8d27e5a71 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:35:38.546934 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-905a6064-91ec-4817-910e-72c8d27e5a71 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:35:38.547370 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-905a6064-91ec-4817-910e-72c8d27e5a71 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:35:38.693316 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-905a6064-91ec-4817-910e-72c8d27e5a71 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:35:38.702243 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-905a6064-91ec-4817-910e-72c8d27e5a71 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:35:38.703733 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-905a6064-91ec-4817-910e-72c8d27e5a71 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:35:38.704931 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-905a6064-91ec-4817-910e-72c8d27e5a71 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] 10.222.0.33 "GET /compute/v2.1/servers/b1a84290-3520-427e-af49-f380d2a144bb" status: 200 len: 1740 microversion: 2.20 time: 0.173419 Jul 18 10:35:38.705771 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 423/838] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jul 18 10:35:38 2022] GET /compute/v2.1/servers/b1a84290-3520-427e-af49-f380d2a144bb => generated 1740 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:35:38.956865 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-af54c93e-0392-4dcd-b674-aaa59486ff54 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:35:38.957755 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-af54c93e-0392-4dcd-b674-aaa59486ff54 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] [instance: 72245495-f5b8-4f54-8d17-ec3e700bdd9b] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:35:38.964682 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-af54c93e-0392-4dcd-b674-aaa59486ff54 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:35:38.965140 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-af54c93e-0392-4dcd-b674-aaa59486ff54 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:35:38.965945 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-af54c93e-0392-4dcd-b674-aaa59486ff54 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:35:38.966388 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-af54c93e-0392-4dcd-b674-aaa59486ff54 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:35:39.121317 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-af54c93e-0392-4dcd-b674-aaa59486ff54 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f25c72896a2d4d619e5ad4b5a0a79aa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cf3d5bfe9a745f38372c42c9cfa1f63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:35:39.129077 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-af54c93e-0392-4dcd-b674-aaa59486ff54 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] 10.222.0.33 "GET /compute/v2.1/servers/72245495-f5b8-4f54-8d17-ec3e700bdd9b" status: 200 len: 1683 microversion: 2.1 time: 0.177252 Jul 18 10:35:39.129917 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 416/839] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:35:38 2022] GET /compute/v2.1/servers/72245495-f5b8-4f54-8d17-ec3e700bdd9b => generated 1683 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:35:39.374953 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-2a1b1016-34cc-4741-aadb-508a9ec9c939 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:35:39.376212 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-2a1b1016-34cc-4741-aadb-508a9ec9c939 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] [instance: 0851efd6-d3b6-44d7-9b22-e327e1bca393] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:35:39.378667 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG dbcounter [-] [117879] Writing DB stats nova_cell0:SELECT=2 {{(pid=117879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:35:39.379479 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG dbcounter [-] [117879] Writing DB stats nova_cell0:SELECT=6 {{(pid=117879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:35:39.392835 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-2a1b1016-34cc-4741-aadb-508a9ec9c939 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:35:39.394453 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-2a1b1016-34cc-4741-aadb-508a9ec9c939 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:35:39.395603 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-2a1b1016-34cc-4741-aadb-508a9ec9c939 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:35:39.396232 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-2a1b1016-34cc-4741-aadb-508a9ec9c939 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:35:39.417607 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-bb10e78c-3bfa-4870-88ae-cef17a7419bd tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:35:39.418391 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-bb10e78c-3bfa-4870-88ae-cef17a7419bd tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] [instance: 9cdd676f-7b24-4c7e-849c-97e196465a3c] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:35:39.425788 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-bb10e78c-3bfa-4870-88ae-cef17a7419bd tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:35:39.426371 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-bb10e78c-3bfa-4870-88ae-cef17a7419bd tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:35:39.427249 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-bb10e78c-3bfa-4870-88ae-cef17a7419bd tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:35:39.427933 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-bb10e78c-3bfa-4870-88ae-cef17a7419bd tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:35:39.548030 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG dbcounter [-] [117880] Writing DB stats nova_cell0:SELECT=2 {{(pid=117880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:35:39.616890 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-2a1b1016-34cc-4741-aadb-508a9ec9c939 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9eb8d188e040bca894e038955f2402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c656b71bbd447cba7d11335c928dfda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:35:39.617380 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-bb10e78c-3bfa-4870-88ae-cef17a7419bd tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '986f90dfbad14324b3fffbd790d60a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e487deb7ff45bdbf2cc002d42d12a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:35:39.620975 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG dbcounter [-] [117880] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:35:39.625911 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-2a1b1016-34cc-4741-aadb-508a9ec9c939 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] 10.222.0.33 "GET /compute/v2.1/servers/0851efd6-d3b6-44d7-9b22-e327e1bca393" status: 200 len: 1265 microversion: 2.1 time: 0.254969 Jul 18 10:35:39.627354 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 424/840] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:35:39 2022] GET /compute/v2.1/servers/0851efd6-d3b6-44d7-9b22-e327e1bca393 => generated 1265 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:35:39.630756 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-bb10e78c-3bfa-4870-88ae-cef17a7419bd tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] 10.222.0.33 "GET /compute/v2.1/servers/9cdd676f-7b24-4c7e-849c-97e196465a3c" status: 200 len: 1671 microversion: 2.1 time: 0.218684 Jul 18 10:35:39.631457 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 417/841] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:35:39 2022] GET /compute/v2.1/servers/9cdd676f-7b24-4c7e-849c-97e196465a3c => generated 1671 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:35:39.723249 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-04449b75-50d4-499d-94c7-fb27208094eb tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:35:39.723875 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-04449b75-50d4-499d-94c7-fb27208094eb tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] [instance: b1a84290-3520-427e-af49-f380d2a144bb] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:35:39.730765 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-04449b75-50d4-499d-94c7-fb27208094eb tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:35:39.731218 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-04449b75-50d4-499d-94c7-fb27208094eb tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:35:39.732022 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-04449b75-50d4-499d-94c7-fb27208094eb tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:35:39.732464 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-04449b75-50d4-499d-94c7-fb27208094eb tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:35:39.885806 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-04449b75-50d4-499d-94c7-fb27208094eb tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:35:39.894466 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-04449b75-50d4-499d-94c7-fb27208094eb tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:35:39.895943 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-04449b75-50d4-499d-94c7-fb27208094eb tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:35:39.897135 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-04449b75-50d4-499d-94c7-fb27208094eb tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] 10.222.0.33 "GET /compute/v2.1/servers/b1a84290-3520-427e-af49-f380d2a144bb" status: 200 len: 1740 microversion: 2.20 time: 0.177942 Jul 18 10:35:39.897679 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 425/842] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jul 18 10:35:39 2022] GET /compute/v2.1/servers/b1a84290-3520-427e-af49-f380d2a144bb => generated 1740 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:35:40.146399 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-aaabe667-b933-41db-841f-09ca945a19b5 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:35:40.147002 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-aaabe667-b933-41db-841f-09ca945a19b5 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] [instance: 72245495-f5b8-4f54-8d17-ec3e700bdd9b] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:35:40.153754 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-aaabe667-b933-41db-841f-09ca945a19b5 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:35:40.154200 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-aaabe667-b933-41db-841f-09ca945a19b5 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:35:40.154965 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-aaabe667-b933-41db-841f-09ca945a19b5 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:35:40.155395 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-aaabe667-b933-41db-841f-09ca945a19b5 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:35:40.284961 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-aaabe667-b933-41db-841f-09ca945a19b5 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f25c72896a2d4d619e5ad4b5a0a79aa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cf3d5bfe9a745f38372c42c9cfa1f63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:35:40.292313 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-aaabe667-b933-41db-841f-09ca945a19b5 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] 10.222.0.33 "GET /compute/v2.1/servers/72245495-f5b8-4f54-8d17-ec3e700bdd9b" status: 200 len: 1683 microversion: 2.1 time: 0.150068 Jul 18 10:35:40.292901 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 418/843] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:35:40 2022] GET /compute/v2.1/servers/72245495-f5b8-4f54-8d17-ec3e700bdd9b => generated 1683 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:35:40.643617 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-786f0a78-9c71-49cd-96a1-ffbed733b14f tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:35:40.644315 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-786f0a78-9c71-49cd-96a1-ffbed733b14f tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] [instance: 0851efd6-d3b6-44d7-9b22-e327e1bca393] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:35:40.649397 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-c72a4684-9d65-4412-9dba-b242c7120583 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:35:40.650005 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-c72a4684-9d65-4412-9dba-b242c7120583 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] [instance: 9cdd676f-7b24-4c7e-849c-97e196465a3c] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:35:40.650542 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-786f0a78-9c71-49cd-96a1-ffbed733b14f tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:35:40.650999 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-786f0a78-9c71-49cd-96a1-ffbed733b14f tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:35:40.652496 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-786f0a78-9c71-49cd-96a1-ffbed733b14f tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:35:40.652968 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-786f0a78-9c71-49cd-96a1-ffbed733b14f tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:35:40.656812 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-c72a4684-9d65-4412-9dba-b242c7120583 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:35:40.658765 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-c72a4684-9d65-4412-9dba-b242c7120583 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:35:40.660150 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-c72a4684-9d65-4412-9dba-b242c7120583 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:35:40.660963 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-c72a4684-9d65-4412-9dba-b242c7120583 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:35:41.069855 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-786f0a78-9c71-49cd-96a1-ffbed733b14f tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9eb8d188e040bca894e038955f2402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c656b71bbd447cba7d11335c928dfda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:35:41.077267 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-786f0a78-9c71-49cd-96a1-ffbed733b14f tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] 10.222.0.33 "GET /compute/v2.1/servers/0851efd6-d3b6-44d7-9b22-e327e1bca393" status: 200 len: 1265 microversion: 2.1 time: 0.437923 Jul 18 10:35:41.087100 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 426/844] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:35:40 2022] GET /compute/v2.1/servers/0851efd6-d3b6-44d7-9b22-e327e1bca393 => generated 1265 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:35:41.087100 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-583779e3-81f4-4b78-99de-a38a56124dd2 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:35:41.087100 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-583779e3-81f4-4b78-99de-a38a56124dd2 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] [instance: b1a84290-3520-427e-af49-f380d2a144bb] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:35:41.089778 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-583779e3-81f4-4b78-99de-a38a56124dd2 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:35:41.090236 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-583779e3-81f4-4b78-99de-a38a56124dd2 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:35:41.091013 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-583779e3-81f4-4b78-99de-a38a56124dd2 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:35:41.091449 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-583779e3-81f4-4b78-99de-a38a56124dd2 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:35:41.141732 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-c72a4684-9d65-4412-9dba-b242c7120583 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '986f90dfbad14324b3fffbd790d60a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e487deb7ff45bdbf2cc002d42d12a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:35:41.149918 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-c72a4684-9d65-4412-9dba-b242c7120583 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] 10.222.0.33 "GET /compute/v2.1/servers/9cdd676f-7b24-4c7e-849c-97e196465a3c" status: 200 len: 1671 microversion: 2.1 time: 0.504331 Jul 18 10:35:41.159226 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 419/845] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:35:40 2022] GET /compute/v2.1/servers/9cdd676f-7b24-4c7e-849c-97e196465a3c => generated 1671 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:35:41.310274 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-164ad2a5-7a52-4994-8a2c-62084a0f9b35 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:35:41.310885 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-164ad2a5-7a52-4994-8a2c-62084a0f9b35 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] [instance: 72245495-f5b8-4f54-8d17-ec3e700bdd9b] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:35:41.318295 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-164ad2a5-7a52-4994-8a2c-62084a0f9b35 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:35:41.318741 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-164ad2a5-7a52-4994-8a2c-62084a0f9b35 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:35:41.319517 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-164ad2a5-7a52-4994-8a2c-62084a0f9b35 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:35:41.319950 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-164ad2a5-7a52-4994-8a2c-62084a0f9b35 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:35:41.922501 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-583779e3-81f4-4b78-99de-a38a56124dd2 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:35:41.930462 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-583779e3-81f4-4b78-99de-a38a56124dd2 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:35:41.931986 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-583779e3-81f4-4b78-99de-a38a56124dd2 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:35:41.933202 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-583779e3-81f4-4b78-99de-a38a56124dd2 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] 10.222.0.33 "GET /compute/v2.1/servers/b1a84290-3520-427e-af49-f380d2a144bb" status: 200 len: 1722 microversion: 2.20 time: 0.854033 Jul 18 10:35:41.933765 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 427/846] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jul 18 10:35:41 2022] GET /compute/v2.1/servers/b1a84290-3520-427e-af49-f380d2a144bb => generated 1722 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:35:42.009074 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-164ad2a5-7a52-4994-8a2c-62084a0f9b35 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f25c72896a2d4d619e5ad4b5a0a79aa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cf3d5bfe9a745f38372c42c9cfa1f63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:35:42.016344 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-164ad2a5-7a52-4994-8a2c-62084a0f9b35 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] 10.222.0.33 "GET /compute/v2.1/servers/72245495-f5b8-4f54-8d17-ec3e700bdd9b" status: 200 len: 1683 microversion: 2.1 time: 0.710019 Jul 18 10:35:42.017176 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 420/847] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:35:41 2022] GET /compute/v2.1/servers/72245495-f5b8-4f54-8d17-ec3e700bdd9b => generated 1683 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:35:42.094718 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-5e3c4c4b-4f50-47e0-99f7-3458f19d9f1a tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:35:42.095399 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-5e3c4c4b-4f50-47e0-99f7-3458f19d9f1a tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] [instance: 0851efd6-d3b6-44d7-9b22-e327e1bca393] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:35:42.101458 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-5e3c4c4b-4f50-47e0-99f7-3458f19d9f1a tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:35:42.102171 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-5e3c4c4b-4f50-47e0-99f7-3458f19d9f1a tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:35:42.102937 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-5e3c4c4b-4f50-47e0-99f7-3458f19d9f1a tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:35:42.103377 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-5e3c4c4b-4f50-47e0-99f7-3458f19d9f1a tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:35:42.166793 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-768d3d16-5bae-4f31-8926-0136ba4b2e7f tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:35:42.167410 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-768d3d16-5bae-4f31-8926-0136ba4b2e7f tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] [instance: 9cdd676f-7b24-4c7e-849c-97e196465a3c] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:35:42.173538 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-768d3d16-5bae-4f31-8926-0136ba4b2e7f tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:35:42.173985 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-768d3d16-5bae-4f31-8926-0136ba4b2e7f tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:35:42.175338 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-768d3d16-5bae-4f31-8926-0136ba4b2e7f tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:35:42.175774 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-768d3d16-5bae-4f31-8926-0136ba4b2e7f tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:35:42.493171 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-5e3c4c4b-4f50-47e0-99f7-3458f19d9f1a tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9eb8d188e040bca894e038955f2402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c656b71bbd447cba7d11335c928dfda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:35:42.500607 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-5e3c4c4b-4f50-47e0-99f7-3458f19d9f1a tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] 10.222.0.33 "GET /compute/v2.1/servers/0851efd6-d3b6-44d7-9b22-e327e1bca393" status: 200 len: 1265 microversion: 2.1 time: 0.409919 Jul 18 10:35:42.501184 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 428/848] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:35:42 2022] GET /compute/v2.1/servers/0851efd6-d3b6-44d7-9b22-e327e1bca393 => generated 1265 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:35:42.805062 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-768d3d16-5bae-4f31-8926-0136ba4b2e7f tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '986f90dfbad14324b3fffbd790d60a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e487deb7ff45bdbf2cc002d42d12a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:35:42.813306 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-768d3d16-5bae-4f31-8926-0136ba4b2e7f tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] 10.222.0.33 "GET /compute/v2.1/servers/9cdd676f-7b24-4c7e-849c-97e196465a3c" status: 200 len: 1671 microversion: 2.1 time: 0.650295 Jul 18 10:35:42.813934 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 421/849] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:35:42 2022] GET /compute/v2.1/servers/9cdd676f-7b24-4c7e-849c-97e196465a3c => generated 1671 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:35:42.951171 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-843312a0-99ff-4a16-81f6-6d15cb7e9d6e tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:35:42.951690 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-843312a0-99ff-4a16-81f6-6d15cb7e9d6e tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] [instance: b1a84290-3520-427e-af49-f380d2a144bb] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:35:42.958791 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-843312a0-99ff-4a16-81f6-6d15cb7e9d6e tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:35:42.959184 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-843312a0-99ff-4a16-81f6-6d15cb7e9d6e tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:35:42.959941 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-843312a0-99ff-4a16-81f6-6d15cb7e9d6e tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:35:42.960370 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-843312a0-99ff-4a16-81f6-6d15cb7e9d6e tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:35:43.033896 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-0442ea25-ed51-4f70-b5f1-5db388cda6c3 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:35:43.035215 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-0442ea25-ed51-4f70-b5f1-5db388cda6c3 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] [instance: 72245495-f5b8-4f54-8d17-ec3e700bdd9b] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:35:43.041872 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-0442ea25-ed51-4f70-b5f1-5db388cda6c3 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:35:43.042458 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-0442ea25-ed51-4f70-b5f1-5db388cda6c3 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:35:43.043324 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-0442ea25-ed51-4f70-b5f1-5db388cda6c3 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:35:43.043851 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-0442ea25-ed51-4f70-b5f1-5db388cda6c3 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:35:43.184163 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-0442ea25-ed51-4f70-b5f1-5db388cda6c3 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f25c72896a2d4d619e5ad4b5a0a79aa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cf3d5bfe9a745f38372c42c9cfa1f63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:35:43.198272 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-0442ea25-ed51-4f70-b5f1-5db388cda6c3 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] 10.222.0.33 "GET /compute/v2.1/servers/72245495-f5b8-4f54-8d17-ec3e700bdd9b" status: 200 len: 1615 microversion: 2.1 time: 0.168224 Jul 18 10:35:43.198956 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 422/850] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:35:43 2022] GET /compute/v2.1/servers/72245495-f5b8-4f54-8d17-ec3e700bdd9b => generated 1615 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:35:43.249975 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [req-760dae31-4ad4-450f-8de1-bed20ee7dc86 req-6c63335c-54bb-42a8-8f9c-191def87c2c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "72245495-f5b8-4f54-8d17-ec3e700bdd9b", "name": "network-vif-deleted", "tag": "bab76dc7-a21a-4a7f-826e-1410690583a4"}]} {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:35:43.260047 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [req-760dae31-4ad4-450f-8de1-bed20ee7dc86 req-6c63335c-54bb-42a8-8f9c-191def87c2c3 service nova] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:35:43.260586 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [req-760dae31-4ad4-450f-8de1-bed20ee7dc86 req-6c63335c-54bb-42a8-8f9c-191def87c2c3 service nova] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:35:43.276203 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.compute.server_external_events [req-760dae31-4ad4-450f-8de1-bed20ee7dc86 req-6c63335c-54bb-42a8-8f9c-191def87c2c3 service nova] Creating event network-vif-deleted:bab76dc7-a21a-4a7f-826e-1410690583a4 for instance 72245495-f5b8-4f54-8d17-ec3e700bdd9b on hv-cinder-83754 Jul 18 10:35:43.282573 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [req-760dae31-4ad4-450f-8de1-bed20ee7dc86 req-6c63335c-54bb-42a8-8f9c-191def87c2c3 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036116 Jul 18 10:35:43.282750 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-843312a0-99ff-4a16-81f6-6d15cb7e9d6e tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:35:43.283165 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 423/851] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jul 18 10:35:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:35:43.300162 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-843312a0-99ff-4a16-81f6-6d15cb7e9d6e tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:35:43.301737 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-843312a0-99ff-4a16-81f6-6d15cb7e9d6e tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:35:43.303267 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-843312a0-99ff-4a16-81f6-6d15cb7e9d6e tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] 10.222.0.33 "GET /compute/v2.1/servers/b1a84290-3520-427e-af49-f380d2a144bb" status: 200 len: 1722 microversion: 2.20 time: 0.355759 Jul 18 10:35:43.308492 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 429/852] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jul 18 10:35:42 2022] GET /compute/v2.1/servers/b1a84290-3520-427e-af49-f380d2a144bb => generated 1722 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:35:43.519068 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-1ddd325e-b77c-4b1b-8b93-816f2a902343 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:35:43.519880 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-1ddd325e-b77c-4b1b-8b93-816f2a902343 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] [instance: 0851efd6-d3b6-44d7-9b22-e327e1bca393] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:35:43.526106 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-1ddd325e-b77c-4b1b-8b93-816f2a902343 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:35:43.526554 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-1ddd325e-b77c-4b1b-8b93-816f2a902343 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:35:43.527316 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-1ddd325e-b77c-4b1b-8b93-816f2a902343 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:35:43.528389 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-1ddd325e-b77c-4b1b-8b93-816f2a902343 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:35:43.671640 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-1ddd325e-b77c-4b1b-8b93-816f2a902343 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9eb8d188e040bca894e038955f2402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c656b71bbd447cba7d11335c928dfda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:35:43.679421 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-1ddd325e-b77c-4b1b-8b93-816f2a902343 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] 10.222.0.33 "GET /compute/v2.1/servers/0851efd6-d3b6-44d7-9b22-e327e1bca393" status: 200 len: 1265 microversion: 2.1 time: 0.165636 Jul 18 10:35:43.679982 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 424/853] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:35:43 2022] GET /compute/v2.1/servers/0851efd6-d3b6-44d7-9b22-e327e1bca393 => generated 1265 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:35:43.830341 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-778d67eb-af18-4b89-9a42-29d048602482 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:35:43.831478 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-778d67eb-af18-4b89-9a42-29d048602482 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] [instance: 9cdd676f-7b24-4c7e-849c-97e196465a3c] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:35:43.837825 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-778d67eb-af18-4b89-9a42-29d048602482 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:35:43.838509 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-778d67eb-af18-4b89-9a42-29d048602482 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:35:43.839278 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-778d67eb-af18-4b89-9a42-29d048602482 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:35:43.839952 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-778d67eb-af18-4b89-9a42-29d048602482 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:35:43.904461 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-778d67eb-af18-4b89-9a42-29d048602482 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '986f90dfbad14324b3fffbd790d60a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e487deb7ff45bdbf2cc002d42d12a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:35:43.912723 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-778d67eb-af18-4b89-9a42-29d048602482 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] 10.222.0.33 "GET /compute/v2.1/servers/9cdd676f-7b24-4c7e-849c-97e196465a3c" status: 200 len: 1603 microversion: 2.1 time: 0.086149 Jul 18 10:35:43.913386 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 430/854] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:35:43 2022] GET /compute/v2.1/servers/9cdd676f-7b24-4c7e-849c-97e196465a3c => generated 1603 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:35:44.215515 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-d7186578-382d-4f31-b986-5ae08764e4ac tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:35:44.216201 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-d7186578-382d-4f31-b986-5ae08764e4ac tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] [instance: 72245495-f5b8-4f54-8d17-ec3e700bdd9b] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:35:44.224383 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-d7186578-382d-4f31-b986-5ae08764e4ac tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:35:44.224965 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-d7186578-382d-4f31-b986-5ae08764e4ac tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:35:44.225814 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-d7186578-382d-4f31-b986-5ae08764e4ac tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:35:44.226382 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-d7186578-382d-4f31-b986-5ae08764e4ac tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:35:44.297836 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-d7186578-382d-4f31-b986-5ae08764e4ac tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f25c72896a2d4d619e5ad4b5a0a79aa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cf3d5bfe9a745f38372c42c9cfa1f63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:35:44.306640 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-d7186578-382d-4f31-b986-5ae08764e4ac tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] 10.222.0.33 "GET /compute/v2.1/servers/72245495-f5b8-4f54-8d17-ec3e700bdd9b" status: 200 len: 1615 microversion: 2.1 time: 0.094886 Jul 18 10:35:44.307211 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 425/855] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:35:44 2022] GET /compute/v2.1/servers/72245495-f5b8-4f54-8d17-ec3e700bdd9b => generated 1615 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:35:44.324913 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-87ff996c-0741-4a0c-ad7b-fc8e2f966464 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:35:44.327957 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-87ff996c-0741-4a0c-ad7b-fc8e2f966464 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] [instance: b1a84290-3520-427e-af49-f380d2a144bb] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:35:44.335338 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-87ff996c-0741-4a0c-ad7b-fc8e2f966464 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:35:44.336263 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-87ff996c-0741-4a0c-ad7b-fc8e2f966464 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:35:44.337339 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-87ff996c-0741-4a0c-ad7b-fc8e2f966464 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:35:44.337467 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-87ff996c-0741-4a0c-ad7b-fc8e2f966464 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:35:44.494451 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-87ff996c-0741-4a0c-ad7b-fc8e2f966464 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:35:44.504106 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-87ff996c-0741-4a0c-ad7b-fc8e2f966464 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:35:44.506033 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-87ff996c-0741-4a0c-ad7b-fc8e2f966464 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:35:44.507360 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-87ff996c-0741-4a0c-ad7b-fc8e2f966464 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] 10.222.0.33 "GET /compute/v2.1/servers/b1a84290-3520-427e-af49-f380d2a144bb" status: 200 len: 1722 microversion: 2.20 time: 0.189954 Jul 18 10:35:44.508345 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 431/856] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jul 18 10:35:44 2022] GET /compute/v2.1/servers/b1a84290-3520-427e-af49-f380d2a144bb => generated 1722 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 10:35:44.696276 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-0383bfce-f65f-473a-a0c0-ad2222a96faf tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:35:44.696901 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-0383bfce-f65f-473a-a0c0-ad2222a96faf tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] [instance: 0851efd6-d3b6-44d7-9b22-e327e1bca393] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:35:44.703258 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-0383bfce-f65f-473a-a0c0-ad2222a96faf tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:35:44.703702 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-0383bfce-f65f-473a-a0c0-ad2222a96faf tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:35:44.704564 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-0383bfce-f65f-473a-a0c0-ad2222a96faf tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:35:44.705005 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-0383bfce-f65f-473a-a0c0-ad2222a96faf tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:35:44.845965 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-0383bfce-f65f-473a-a0c0-ad2222a96faf tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9eb8d188e040bca894e038955f2402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c656b71bbd447cba7d11335c928dfda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:35:44.854437 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-0383bfce-f65f-473a-a0c0-ad2222a96faf tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] 10.222.0.33 "GET /compute/v2.1/servers/0851efd6-d3b6-44d7-9b22-e327e1bca393" status: 200 len: 1265 microversion: 2.1 time: 0.162173 Jul 18 10:35:44.855088 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 426/857] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:35:44 2022] GET /compute/v2.1/servers/0851efd6-d3b6-44d7-9b22-e327e1bca393 => generated 1265 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:35:44.930098 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-e83c6654-4850-497b-9985-0677ccc01977 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:35:44.930707 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-e83c6654-4850-497b-9985-0677ccc01977 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] [instance: 9cdd676f-7b24-4c7e-849c-97e196465a3c] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:35:44.936669 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-e83c6654-4850-497b-9985-0677ccc01977 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:35:44.937128 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-e83c6654-4850-497b-9985-0677ccc01977 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:35:44.937926 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-e83c6654-4850-497b-9985-0677ccc01977 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:35:44.938371 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-e83c6654-4850-497b-9985-0677ccc01977 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:35:44.968334 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-e83c6654-4850-497b-9985-0677ccc01977 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:35:44.968822 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-e83c6654-4850-497b-9985-0677ccc01977 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:35:44.969270 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.objects.instance [None req-e83c6654-4850-497b-9985-0677ccc01977 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lazy-loading 'fault' on Instance uuid 9cdd676f-7b24-4c7e-849c-97e196465a3c {{(pid=117879) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 10:35:45.009178 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-e83c6654-4850-497b-9985-0677ccc01977 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '986f90dfbad14324b3fffbd790d60a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e487deb7ff45bdbf2cc002d42d12a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:35:45.016443 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-e83c6654-4850-497b-9985-0677ccc01977 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] 10.222.0.33 "GET /compute/v2.1/servers/9cdd676f-7b24-4c7e-849c-97e196465a3c" status: 200 len: 1325 microversion: 2.1 time: 0.090166 Jul 18 10:35:45.017042 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 432/858] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:35:44 2022] GET /compute/v2.1/servers/9cdd676f-7b24-4c7e-849c-97e196465a3c => generated 1325 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:35:45.297934 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [req-53d84629-cdf4-4c51-8aac-85eaa008cd03 req-074e6845-e229-4334-9bdc-b9ccf2c63bf8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9cdd676f-7b24-4c7e-849c-97e196465a3c", "name": "network-vif-deleted", "tag": "bf588d31-1331-4764-a116-500faf7ec561"}]} {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:35:45.308287 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [req-53d84629-cdf4-4c51-8aac-85eaa008cd03 req-074e6845-e229-4334-9bdc-b9ccf2c63bf8 service nova] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:35:45.308746 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [req-53d84629-cdf4-4c51-8aac-85eaa008cd03 req-074e6845-e229-4334-9bdc-b9ccf2c63bf8 service nova] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:35:45.322835 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.compute.server_external_events [req-53d84629-cdf4-4c51-8aac-85eaa008cd03 req-074e6845-e229-4334-9bdc-b9ccf2c63bf8 service nova] Creating event network-vif-deleted:bf588d31-1331-4764-a116-500faf7ec561 for instance 9cdd676f-7b24-4c7e-849c-97e196465a3c on hv-cinder-83754 Jul 18 10:35:45.330061 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-40c90d4e-f169-49cd-8289-f8e73a72d0b6 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:35:45.332089 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-40c90d4e-f169-49cd-8289-f8e73a72d0b6 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] [instance: 72245495-f5b8-4f54-8d17-ec3e700bdd9b] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:35:45.334065 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [req-53d84629-cdf4-4c51-8aac-85eaa008cd03 req-074e6845-e229-4334-9bdc-b9ccf2c63bf8 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040238 Jul 18 10:35:45.334688 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 427/859] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jul 18 10:35:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:35:45.344210 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-40c90d4e-f169-49cd-8289-f8e73a72d0b6 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:35:45.345037 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-40c90d4e-f169-49cd-8289-f8e73a72d0b6 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:35:45.345988 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-40c90d4e-f169-49cd-8289-f8e73a72d0b6 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:35:45.347320 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-40c90d4e-f169-49cd-8289-f8e73a72d0b6 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:35:45.389904 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-40c90d4e-f169-49cd-8289-f8e73a72d0b6 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:35:45.390353 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-40c90d4e-f169-49cd-8289-f8e73a72d0b6 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:35:45.390807 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.objects.instance [None req-40c90d4e-f169-49cd-8289-f8e73a72d0b6 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lazy-loading 'fault' on Instance uuid 72245495-f5b8-4f54-8d17-ec3e700bdd9b {{(pid=117879) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 10:35:45.433988 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-40c90d4e-f169-49cd-8289-f8e73a72d0b6 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f25c72896a2d4d619e5ad4b5a0a79aa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cf3d5bfe9a745f38372c42c9cfa1f63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:35:45.441277 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-40c90d4e-f169-49cd-8289-f8e73a72d0b6 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] 10.222.0.33 "GET /compute/v2.1/servers/72245495-f5b8-4f54-8d17-ec3e700bdd9b" status: 200 len: 1332 microversion: 2.1 time: 0.117759 Jul 18 10:35:45.441844 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 433/860] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:35:45 2022] GET /compute/v2.1/servers/72245495-f5b8-4f54-8d17-ec3e700bdd9b => generated 1332 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:35:45.526026 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-d67aa63d-a449-47d3-95d4-2a8559503a2a tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:35:45.526700 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-d67aa63d-a449-47d3-95d4-2a8559503a2a tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] [instance: b1a84290-3520-427e-af49-f380d2a144bb] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:35:45.532824 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-d67aa63d-a449-47d3-95d4-2a8559503a2a tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:35:45.533266 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-d67aa63d-a449-47d3-95d4-2a8559503a2a tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:35:45.534052 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-d67aa63d-a449-47d3-95d4-2a8559503a2a tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:35:45.534479 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-d67aa63d-a449-47d3-95d4-2a8559503a2a tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:35:45.680027 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-d67aa63d-a449-47d3-95d4-2a8559503a2a tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:35:45.688950 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-d67aa63d-a449-47d3-95d4-2a8559503a2a tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:35:45.691153 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-d67aa63d-a449-47d3-95d4-2a8559503a2a tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:35:45.692553 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-d67aa63d-a449-47d3-95d4-2a8559503a2a tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] 10.222.0.33 "GET /compute/v2.1/servers/b1a84290-3520-427e-af49-f380d2a144bb" status: 200 len: 1725 microversion: 2.20 time: 0.170693 Jul 18 10:35:45.693103 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 428/861] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jul 18 10:35:45 2022] GET /compute/v2.1/servers/b1a84290-3520-427e-af49-f380d2a144bb => generated 1725 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:35:45.713279 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-6a702d41-334e-4479-9d54-e218393ed93a tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "90f960a6-ef49-4631-80eb-500ad04d5001"}} {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:35:45.714176 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-6a702d41-334e-4479-9d54-e218393ed93a tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] [instance: b1a84290-3520-427e-af49-f380d2a144bb] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:35:45.720395 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-6a702d41-334e-4479-9d54-e218393ed93a tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:35:45.720878 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-6a702d41-334e-4479-9d54-e218393ed93a tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:35:45.721685 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-6a702d41-334e-4479-9d54-e218393ed93a tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:35:45.722120 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-6a702d41-334e-4479-9d54-e218393ed93a tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:35:45.725690 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG dbcounter [-] [117879] Writing DB stats nova_cell1:SELECT=100 {{(pid=117879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:35:45.873485 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-ac81ab79-455a-4fca-9363-ce72037deaf0 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:35:45.874427 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-ac81ab79-455a-4fca-9363-ce72037deaf0 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] [instance: 0851efd6-d3b6-44d7-9b22-e327e1bca393] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:35:45.881563 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-ac81ab79-455a-4fca-9363-ce72037deaf0 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:35:45.882129 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-ac81ab79-455a-4fca-9363-ce72037deaf0 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:35:45.882897 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-ac81ab79-455a-4fca-9363-ce72037deaf0 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:35:45.883580 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-ac81ab79-455a-4fca-9363-ce72037deaf0 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:35:46.035514 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-6a702d41-334e-4479-9d54-e218393ed93a tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] 10.222.0.33 "POST /compute/v2.1/servers/b1a84290-3520-427e-af49-f380d2a144bb/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.326312 Jul 18 10:35:46.036636 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 434/862] 10.222.0.33 () {62 vars in 1363 bytes} [Mon Jul 18 10:35:45 2022] POST /compute/v2.1/servers/b1a84290-3520-427e-af49-f380d2a144bb/os-volume_attachments => generated 188 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 10:35:46.041717 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [req-041f954c-ccf9-4a5c-8282-2b450bc0d14b req-7bad3625-b384-4408-81da-5f94690bbc2f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0851efd6-d3b6-44d7-9b22-e327e1bca393", "name": "network-vif-plugged", "status": "completed", "tag": "ef589bb7-916e-48f9-bce4-fdf64f4ed1b1"}]} {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:35:46.045791 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-ac81ab79-455a-4fca-9363-ce72037deaf0 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9eb8d188e040bca894e038955f2402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c656b71bbd447cba7d11335c928dfda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:35:46.051760 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [req-041f954c-ccf9-4a5c-8282-2b450bc0d14b req-7bad3625-b384-4408-81da-5f94690bbc2f service nova] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:35:46.052299 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [req-041f954c-ccf9-4a5c-8282-2b450bc0d14b req-7bad3625-b384-4408-81da-5f94690bbc2f service nova] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:35:46.058453 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-ac81ab79-455a-4fca-9363-ce72037deaf0 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] 10.222.0.33 "GET /compute/v2.1/servers/0851efd6-d3b6-44d7-9b22-e327e1bca393" status: 200 len: 1265 microversion: 2.1 time: 0.189492 Jul 18 10:35:46.059984 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 429/863] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:35:45 2022] GET /compute/v2.1/servers/0851efd6-d3b6-44d7-9b22-e327e1bca393 => generated 1265 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:35:46.067835 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-22d4a4b8-fa75-4c04-8c1c-877d35ea6128 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:35:46.068728 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-22d4a4b8-fa75-4c04-8c1c-877d35ea6128 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] [instance: 9cdd676f-7b24-4c7e-849c-97e196465a3c] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:35:46.073436 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.compute.server_external_events [req-041f954c-ccf9-4a5c-8282-2b450bc0d14b req-7bad3625-b384-4408-81da-5f94690bbc2f service nova] Creating event network-vif-plugged:ef589bb7-916e-48f9-bce4-fdf64f4ed1b1 for instance 0851efd6-d3b6-44d7-9b22-e327e1bca393 on hv-cinder-83754 Jul 18 10:35:46.075941 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-22d4a4b8-fa75-4c04-8c1c-877d35ea6128 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:35:46.076611 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-22d4a4b8-fa75-4c04-8c1c-877d35ea6128 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:35:46.077857 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-22d4a4b8-fa75-4c04-8c1c-877d35ea6128 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:35:46.078441 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-22d4a4b8-fa75-4c04-8c1c-877d35ea6128 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:35:46.079658 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [req-041f954c-ccf9-4a5c-8282-2b450bc0d14b req-7bad3625-b384-4408-81da-5f94690bbc2f service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041523 Jul 18 10:35:46.081004 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 435/864] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jul 18 10:35:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:35:46.092864 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.wsgi [None req-22d4a4b8-fa75-4c04-8c1c-877d35ea6128 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] HTTP exception thrown: Instance 9cdd676f-7b24-4c7e-849c-97e196465a3c could not be found. Jul 18 10:35:46.094667 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-22d4a4b8-fa75-4c04-8c1c-877d35ea6128 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Request method failure captured: Jul 18 10:35:46.094667 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: request: GET /compute/v2.1/servers/9cdd676f-7b24-4c7e-849c-97e196465a3c HTTP/1.1 Jul 18 10:35:46.094667 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: Accept: application/json Jul 18 10:35:46.094667 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: Accept-Encoding: identity Jul 18 10:35:46.094667 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: Connection: close Jul 18 10:35:46.094667 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: Content-Length: 0 Jul 18 10:35:46.094667 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: Content-Type: application/json Jul 18 10:35:46.094667 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: Host: 10.222.0.33 Jul 18 10:35:46.094667 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: Openstack-System-Scope: None Jul 18 10:35:46.094667 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: User-Agent: python-urllib3/1.26.9 Jul 18 10:35:46.094667 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Auth-Token: gAAAAABi1TXyRuO93YpXTZGzpMcrXvlaMSRFZzr-AHOj2FRT2T5ihWk1lnTRwNGg9PrJbZQjx8rFUCx5FHM_0tuFNIv3bWjwRyt64fUTE1eFuCeWcTmRM14gEGuSdmP8w3Abds2w_lZwqjtKT13oQUVwIT92owvlu3szREV5s5g3P_QW6cRnhQU Jul 18 10:35:46.094667 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Domain-Id: None Jul 18 10:35:46.094667 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Domain-Name: None Jul 18 10:35:46.094667 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Identity-Status: Confirmed Jul 18 10:35:46.094667 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Is-Admin-Project: True Jul 18 10:35:46.094667 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Project-Domain-Id: default Jul 18 10:35:46.094667 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Project-Domain-Name: Default Jul 18 10:35:46.094667 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Project-Id: e6e487deb7ff45bdbf2cc002d42d12a5 Jul 18 10:35:46.094667 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Project-Name: tempest-AttachVolumeTestJSON-1614237976 Jul 18 10:35:46.094667 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Role: member,reader Jul 18 10:35:46.094667 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Roles: member,reader Jul 18 10:35:46.096647 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e6e487deb7ff45bdbf2cc002d42d12a5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e6e487deb7ff45bdbf2cc002d42d12a5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/e6e487deb7ff45bdbf2cc002d42d12a5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_e6e487deb7ff45bdbf2cc002d42d12a5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jul 18 10:35:46.096647 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Tenant: tempest-AttachVolumeTestJSON-1614237976 Jul 18 10:35:46.096647 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Tenant-Id: e6e487deb7ff45bdbf2cc002d42d12a5 Jul 18 10:35:46.096647 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1614237976 Jul 18 10:35:46.096647 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-User: tempest-AttachVolumeTestJSON-1614237976-project Jul 18 10:35:46.096647 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-User-Domain-Id: default Jul 18 10:35:46.096647 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-User-Domain-Name: Default Jul 18 10:35:46.096647 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-User-Id: 986f90dfbad14324b3fffbd790d60a37 Jul 18 10:35:46.096647 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-User-Name: tempest-AttachVolumeTestJSON-1614237976-project Jul 18 10:35:46.096647 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: method: > Jul 18 10:35:46.096647 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: exception: Instance 9cdd676f-7b24-4c7e-849c-97e196465a3c could not be found. Jul 18 10:35:46.096647 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: action_args: {'id': '9cdd676f-7b24-4c7e-849c-97e196465a3c'} Jul 18 10:35:46.097472 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 10:35:46.097472 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:35:46.097472 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 10:35:46.097472 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 10:35:46.097472 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 10:35:46.097472 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 10:35:46.097472 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 10:35:46.097472 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 10:35:46.097472 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 10:35:46.097472 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 10:35:46.097472 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9cdd676f-7b24-4c7e-849c-97e196465a3c could not be found. Jul 18 10:35:46.097472 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi Jul 18 10:35:46.097472 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:35:46.097472 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi Jul 18 10:35:46.097472 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:35:46.097472 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:35:46.097472 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:35:46.097472 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 10:35:46.097472 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 10:35:46.097472 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 10:35:46.099164 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 10:35:46.099164 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 10:35:46.099164 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 10:35:46.099164 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 10:35:46.099164 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 10:35:46.099164 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 10:35:46.099164 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 10:35:46.099164 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9cdd676f-7b24-4c7e-849c-97e196465a3c could not be found. Jul 18 10:35:46.099164 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi Jul 18 10:35:46.099164 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:35:46.099164 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi Jul 18 10:35:46.099164 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:35:46.099164 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:35:46.099164 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:35:46.099164 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 10:35:46.099164 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 10:35:46.099164 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9cdd676f-7b24-4c7e-849c-97e196465a3c could not be found. Jul 18 10:35:46.099164 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi Jul 18 10:35:46.100822 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-22d4a4b8-fa75-4c04-8c1c-877d35ea6128 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Returning 404 to user: Instance 9cdd676f-7b24-4c7e-849c-97e196465a3c could not be found. {{(pid=117880) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 10:35:46.100822 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-22d4a4b8-fa75-4c04-8c1c-877d35ea6128 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] 10.222.0.33 "GET /compute/v2.1/servers/9cdd676f-7b24-4c7e-849c-97e196465a3c" status: 404 len: 111 microversion: 2.1 time: 0.034984 Jul 18 10:35:46.100822 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 430/865] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:35:46 2022] GET /compute/v2.1/servers/9cdd676f-7b24-4c7e-849c-97e196465a3c => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 10:35:46.106498 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-ac1ef079-e240-4657-a0c6-b27ae1119f1e tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Calling method '.version_select at 0x7f9f49fd3ee0>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:35:46.132020 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-ac1ef079-e240-4657-a0c6-b27ae1119f1e tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-27111566" status: 202 len: 0 microversion: 2.1 time: 0.029175 Jul 18 10:35:46.133297 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 436/866] 10.222.0.33 () {58 vars in 1214 bytes} [Mon Jul 18 10:35:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-27111566 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 10:35:46.182956 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-0120aca2-249c-4d66-93e1-bf664dcf5a18 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:35:46.183544 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-0120aca2-249c-4d66-93e1-bf664dcf5a18 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] [instance: b1a84290-3520-427e-af49-f380d2a144bb] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:35:46.190126 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-0120aca2-249c-4d66-93e1-bf664dcf5a18 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:35:46.190563 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-0120aca2-249c-4d66-93e1-bf664dcf5a18 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:35:46.191333 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-0120aca2-249c-4d66-93e1-bf664dcf5a18 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:35:46.191762 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-0120aca2-249c-4d66-93e1-bf664dcf5a18 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:35:46.293811 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-0120aca2-249c-4d66-93e1-bf664dcf5a18 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] 10.222.0.33 "POST /compute/v2.1/servers/b1a84290-3520-427e-af49-f380d2a144bb/action" status: 202 len: 0 microversion: 2.20 time: 0.114246 Jul 18 10:35:46.297967 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 431/867] 10.222.0.33 () {62 vars in 1318 bytes} [Mon Jul 18 10:35:46 2022] POST /compute/v2.1/servers/b1a84290-3520-427e-af49-f380d2a144bb/action => generated 0 bytes in 119 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 18 10:35:46.303381 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-6302c19f-e8e2-438e-8873-b509b45f6638 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:35:46.304251 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-6302c19f-e8e2-438e-8873-b509b45f6638 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] [instance: b1a84290-3520-427e-af49-f380d2a144bb] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:35:46.316222 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-6302c19f-e8e2-438e-8873-b509b45f6638 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:35:46.316742 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-6302c19f-e8e2-438e-8873-b509b45f6638 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:35:46.317558 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-6302c19f-e8e2-438e-8873-b509b45f6638 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:35:46.317997 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-6302c19f-e8e2-438e-8873-b509b45f6638 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:35:46.458940 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-374b0917-3bdb-4acc-8816-737c65342f07 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:35:46.459939 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-374b0917-3bdb-4acc-8816-737c65342f07 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] [instance: 72245495-f5b8-4f54-8d17-ec3e700bdd9b] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:35:46.467043 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-374b0917-3bdb-4acc-8816-737c65342f07 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:35:46.467859 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-374b0917-3bdb-4acc-8816-737c65342f07 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:35:46.469006 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-374b0917-3bdb-4acc-8816-737c65342f07 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:35:46.469683 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-374b0917-3bdb-4acc-8816-737c65342f07 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:35:46.486024 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.wsgi [None req-374b0917-3bdb-4acc-8816-737c65342f07 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] HTTP exception thrown: Instance 72245495-f5b8-4f54-8d17-ec3e700bdd9b could not be found. Jul 18 10:35:46.488521 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-374b0917-3bdb-4acc-8816-737c65342f07 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Request method failure captured: Jul 18 10:35:46.488521 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: request: GET /compute/v2.1/servers/72245495-f5b8-4f54-8d17-ec3e700bdd9b HTTP/1.1 Jul 18 10:35:46.488521 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: Accept: application/json Jul 18 10:35:46.488521 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: Accept-Encoding: identity Jul 18 10:35:46.488521 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: Connection: close Jul 18 10:35:46.488521 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: Content-Length: 0 Jul 18 10:35:46.488521 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: Content-Type: application/json Jul 18 10:35:46.488521 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: Host: 10.222.0.33 Jul 18 10:35:46.488521 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: Openstack-System-Scope: None Jul 18 10:35:46.488521 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: User-Agent: python-urllib3/1.26.9 Jul 18 10:35:46.488521 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Auth-Token: gAAAAABi1TXs5d9KA6TlIG1Li_VNjhkDxvVxs6ByaKH91Tp5cEYBI8OTiNSNI40UEe5MBLfNqlyuYAjUMpiV_qMg9jtmq9fJwxP3wvSLbrM9kN7Z4diK5bpD5WWlO_9PNIu02mzK2QxOqaTdn-MDBEh-IwIUUSwgtjyQOUrIhUK0fhFwotym42k Jul 18 10:35:46.488521 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Domain-Id: None Jul 18 10:35:46.488521 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Domain-Name: None Jul 18 10:35:46.488521 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Identity-Status: Confirmed Jul 18 10:35:46.488521 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Is-Admin-Project: True Jul 18 10:35:46.488521 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Project-Domain-Id: default Jul 18 10:35:46.488521 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Project-Domain-Name: Default Jul 18 10:35:46.488521 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Project-Id: 1cf3d5bfe9a745f38372c42c9cfa1f63 Jul 18 10:35:46.488521 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Project-Name: tempest-AttachVolumeNegativeTest-653274830 Jul 18 10:35:46.488521 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Role: member,reader Jul 18 10:35:46.488521 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Roles: member,reader Jul 18 10:35:46.489914 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1cf3d5bfe9a745f38372c42c9cfa1f63"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1cf3d5bfe9a745f38372c42c9cfa1f63"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/1cf3d5bfe9a745f38372c42c9cfa1f63"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_1cf3d5bfe9a745f38372c42c9cfa1f63"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jul 18 10:35:46.489914 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Tenant: tempest-AttachVolumeNegativeTest-653274830 Jul 18 10:35:46.489914 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Tenant-Id: 1cf3d5bfe9a745f38372c42c9cfa1f63 Jul 18 10:35:46.489914 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-653274830 Jul 18 10:35:46.489914 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-User: tempest-AttachVolumeNegativeTest-653274830-project Jul 18 10:35:46.489914 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-User-Domain-Id: default Jul 18 10:35:46.489914 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-User-Domain-Name: Default Jul 18 10:35:46.489914 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-User-Id: f25c72896a2d4d619e5ad4b5a0a79aa6 Jul 18 10:35:46.489914 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-User-Name: tempest-AttachVolumeNegativeTest-653274830-project Jul 18 10:35:46.489914 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: method: > Jul 18 10:35:46.489914 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: exception: Instance 72245495-f5b8-4f54-8d17-ec3e700bdd9b could not be found. Jul 18 10:35:46.489914 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: action_args: {'id': '72245495-f5b8-4f54-8d17-ec3e700bdd9b'} Jul 18 10:35:46.490692 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 10:35:46.490692 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:35:46.490692 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 10:35:46.490692 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 10:35:46.490692 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 10:35:46.490692 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 10:35:46.490692 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 10:35:46.490692 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 10:35:46.490692 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 10:35:46.490692 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 10:35:46.490692 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 72245495-f5b8-4f54-8d17-ec3e700bdd9b could not be found. Jul 18 10:35:46.490692 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi Jul 18 10:35:46.490692 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:35:46.490692 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi Jul 18 10:35:46.490692 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:35:46.490692 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:35:46.490692 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:35:46.490692 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 10:35:46.490692 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 10:35:46.490692 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 10:35:46.491961 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 10:35:46.491961 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 10:35:46.491961 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 10:35:46.491961 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 10:35:46.491961 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 10:35:46.491961 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 10:35:46.491961 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 10:35:46.491961 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 72245495-f5b8-4f54-8d17-ec3e700bdd9b could not be found. Jul 18 10:35:46.491961 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi Jul 18 10:35:46.491961 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:35:46.491961 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi Jul 18 10:35:46.491961 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:35:46.491961 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:35:46.491961 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:35:46.491961 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 10:35:46.491961 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 10:35:46.491961 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 72245495-f5b8-4f54-8d17-ec3e700bdd9b could not be found. Jul 18 10:35:46.491961 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi Jul 18 10:35:46.495522 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-374b0917-3bdb-4acc-8816-737c65342f07 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Returning 404 to user: Instance 72245495-f5b8-4f54-8d17-ec3e700bdd9b could not be found. {{(pid=117880) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 10:35:46.496486 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-374b0917-3bdb-4acc-8816-737c65342f07 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] 10.222.0.33 "GET /compute/v2.1/servers/72245495-f5b8-4f54-8d17-ec3e700bdd9b" status: 404 len: 111 microversion: 2.1 time: 0.042220 Jul 18 10:35:46.497187 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 432/868] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:35:46 2022] GET /compute/v2.1/servers/72245495-f5b8-4f54-8d17-ec3e700bdd9b => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 18 10:35:46.497517 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-6302c19f-e8e2-438e-8873-b509b45f6638 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:35:46.506350 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-a8f6bd24-3891-4864-962d-997c01c4c75b tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Calling method '.version_select at 0x7f9f4a3db040>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:35:46.507827 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-6302c19f-e8e2-438e-8873-b509b45f6638 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:35:46.509577 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-6302c19f-e8e2-438e-8873-b509b45f6638 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:35:46.511241 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-6302c19f-e8e2-438e-8873-b509b45f6638 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] 10.222.0.33 "GET /compute/v2.1/servers/b1a84290-3520-427e-af49-f380d2a144bb" status: 200 len: 1751 microversion: 2.20 time: 0.212454 Jul 18 10:35:46.511811 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 437/869] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jul 18 10:35:46 2022] GET /compute/v2.1/servers/b1a84290-3520-427e-af49-f380d2a144bb => generated 1751 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 10:35:46.531731 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-a8f6bd24-3891-4864-962d-997c01c4c75b tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1648601324" status: 202 len: 0 microversion: 2.1 time: 0.029561 Jul 18 10:35:46.532611 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 433/870] 10.222.0.33 () {58 vars in 1220 bytes} [Mon Jul 18 10:35:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1648601324 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 18 10:35:47.077854 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-9972b839-016e-4812-a94d-ebad8f4a3c56 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:35:47.078787 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-9972b839-016e-4812-a94d-ebad8f4a3c56 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] [instance: 0851efd6-d3b6-44d7-9b22-e327e1bca393] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:35:47.089532 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-9972b839-016e-4812-a94d-ebad8f4a3c56 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:35:47.090002 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-9972b839-016e-4812-a94d-ebad8f4a3c56 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:35:47.090799 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-9972b839-016e-4812-a94d-ebad8f4a3c56 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:35:47.091257 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-9972b839-016e-4812-a94d-ebad8f4a3c56 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:35:47.531562 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-0d222354-e53b-4ce3-8d7e-b40d7d51a5e8 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:35:47.532242 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-0d222354-e53b-4ce3-8d7e-b40d7d51a5e8 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] [instance: b1a84290-3520-427e-af49-f380d2a144bb] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:35:47.538808 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-0d222354-e53b-4ce3-8d7e-b40d7d51a5e8 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:35:47.539458 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-0d222354-e53b-4ce3-8d7e-b40d7d51a5e8 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:35:47.540604 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-0d222354-e53b-4ce3-8d7e-b40d7d51a5e8 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:35:47.541036 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-0d222354-e53b-4ce3-8d7e-b40d7d51a5e8 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:35:47.634903 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-9972b839-016e-4812-a94d-ebad8f4a3c56 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9eb8d188e040bca894e038955f2402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c656b71bbd447cba7d11335c928dfda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:35:47.643757 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-9972b839-016e-4812-a94d-ebad8f4a3c56 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] 10.222.0.33 "GET /compute/v2.1/servers/0851efd6-d3b6-44d7-9b22-e327e1bca393" status: 200 len: 1265 microversion: 2.1 time: 0.569669 Jul 18 10:35:47.644529 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 438/871] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:35:47 2022] GET /compute/v2.1/servers/0851efd6-d3b6-44d7-9b22-e327e1bca393 => generated 1265 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:35:47.744437 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-0d222354-e53b-4ce3-8d7e-b40d7d51a5e8 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:35:47.753775 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-0d222354-e53b-4ce3-8d7e-b40d7d51a5e8 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:35:47.755374 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-0d222354-e53b-4ce3-8d7e-b40d7d51a5e8 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:35:47.756737 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-0d222354-e53b-4ce3-8d7e-b40d7d51a5e8 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] 10.222.0.33 "GET /compute/v2.1/servers/b1a84290-3520-427e-af49-f380d2a144bb" status: 200 len: 1751 microversion: 2.20 time: 0.230710 Jul 18 10:35:47.757428 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 434/872] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jul 18 10:35:47 2022] GET /compute/v2.1/servers/b1a84290-3520-427e-af49-f380d2a144bb => generated 1751 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 10:35:48.096036 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [req-5f32ded7-ba75-41b9-9a2b-59719b654927 req-95d74f42-a669-4a07-8f5c-2305b5549378 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b1a84290-3520-427e-af49-f380d2a144bb", "name": "network-vif-unplugged", "status": "completed", "tag": "b5aa065e-e228-4681-909e-bd39389938fd"}]} {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:35:48.104324 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [req-5f32ded7-ba75-41b9-9a2b-59719b654927 req-95d74f42-a669-4a07-8f5c-2305b5549378 service nova] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:35:48.104787 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [req-5f32ded7-ba75-41b9-9a2b-59719b654927 req-95d74f42-a669-4a07-8f5c-2305b5549378 service nova] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:35:48.116018 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.compute.server_external_events [req-5f32ded7-ba75-41b9-9a2b-59719b654927 req-95d74f42-a669-4a07-8f5c-2305b5549378 service nova] Unable to find a host for instance b1a84290-3520-427e-af49-f380d2a144bb. Dropping event network-vif-unplugged {{(pid=117879) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 18 10:35:48.116901 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [req-5f32ded7-ba75-41b9-9a2b-59719b654927 req-95d74f42-a669-4a07-8f5c-2305b5549378 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.024653 Jul 18 10:35:48.117452 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 439/873] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jul 18 10:35:48 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 26 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jul 18 10:35:48.662242 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-2d1de7a4-18f0-4b35-8c64-aacd2c344524 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:35:48.662850 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-2d1de7a4-18f0-4b35-8c64-aacd2c344524 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] [instance: 0851efd6-d3b6-44d7-9b22-e327e1bca393] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:35:48.669393 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-2d1de7a4-18f0-4b35-8c64-aacd2c344524 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:35:48.669845 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-2d1de7a4-18f0-4b35-8c64-aacd2c344524 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:35:48.670605 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-2d1de7a4-18f0-4b35-8c64-aacd2c344524 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:35:48.671037 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-2d1de7a4-18f0-4b35-8c64-aacd2c344524 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:35:48.775075 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-12cffb21-03ea-47e5-80b8-293ef41ba36f tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:35:48.775708 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-12cffb21-03ea-47e5-80b8-293ef41ba36f tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] [instance: b1a84290-3520-427e-af49-f380d2a144bb] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:35:48.782084 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-12cffb21-03ea-47e5-80b8-293ef41ba36f tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:35:48.782586 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-12cffb21-03ea-47e5-80b8-293ef41ba36f tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:35:48.783301 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-12cffb21-03ea-47e5-80b8-293ef41ba36f tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:35:48.783745 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-12cffb21-03ea-47e5-80b8-293ef41ba36f tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:35:48.806548 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-2d1de7a4-18f0-4b35-8c64-aacd2c344524 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9eb8d188e040bca894e038955f2402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c656b71bbd447cba7d11335c928dfda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:35:48.814119 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-2d1de7a4-18f0-4b35-8c64-aacd2c344524 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] 10.222.0.33 "GET /compute/v2.1/servers/0851efd6-d3b6-44d7-9b22-e327e1bca393" status: 200 len: 1452 microversion: 2.1 time: 0.156200 Jul 18 10:35:48.814714 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 435/874] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:35:48 2022] GET /compute/v2.1/servers/0851efd6-d3b6-44d7-9b22-e327e1bca393 => generated 1452 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:35:48.830261 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-039efd18-7dc6-420d-8f17-6ffa01b0622b tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:35:48.831529 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-039efd18-7dc6-420d-8f17-6ffa01b0622b tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] [instance: 0851efd6-d3b6-44d7-9b22-e327e1bca393] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:35:48.838915 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-039efd18-7dc6-420d-8f17-6ffa01b0622b tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:35:48.839381 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-039efd18-7dc6-420d-8f17-6ffa01b0622b tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:35:48.840138 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-039efd18-7dc6-420d-8f17-6ffa01b0622b tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:35:48.840644 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-039efd18-7dc6-420d-8f17-6ffa01b0622b tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:35:49.082751 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-12cffb21-03ea-47e5-80b8-293ef41ba36f tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:35:49.086487 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-039efd18-7dc6-420d-8f17-6ffa01b0622b tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9eb8d188e040bca894e038955f2402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c656b71bbd447cba7d11335c928dfda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:35:49.091879 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-12cffb21-03ea-47e5-80b8-293ef41ba36f tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:35:49.093430 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-12cffb21-03ea-47e5-80b8-293ef41ba36f tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:35:49.094320 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-039efd18-7dc6-420d-8f17-6ffa01b0622b tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] 10.222.0.33 "GET /compute/v2.1/servers/0851efd6-d3b6-44d7-9b22-e327e1bca393" status: 200 len: 1452 microversion: 2.1 time: 0.267719 Jul 18 10:35:49.094597 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-12cffb21-03ea-47e5-80b8-293ef41ba36f tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] 10.222.0.33 "GET /compute/v2.1/servers/b1a84290-3520-427e-af49-f380d2a144bb" status: 200 len: 1809 microversion: 2.20 time: 0.323380 Jul 18 10:35:49.094881 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 436/875] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:35:48 2022] GET /compute/v2.1/servers/0851efd6-d3b6-44d7-9b22-e327e1bca393 => generated 1452 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:35:49.095155 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 440/876] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jul 18 10:35:48 2022] GET /compute/v2.1/servers/b1a84290-3520-427e-af49-f380d2a144bb => generated 1809 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 10:35:49.115520 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-688c243b-12ef-432d-a8e2-2712d499f088 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:35:49.116294 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-688c243b-12ef-432d-a8e2-2712d499f088 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] [instance: 72245495-f5b8-4f54-8d17-ec3e700bdd9b] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:35:49.123133 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-688c243b-12ef-432d-a8e2-2712d499f088 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:35:49.123588 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-688c243b-12ef-432d-a8e2-2712d499f088 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:35:49.124981 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-688c243b-12ef-432d-a8e2-2712d499f088 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:35:49.125776 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-688c243b-12ef-432d-a8e2-2712d499f088 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:35:49.130457 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG dbcounter [-] [117880] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:35:49.141249 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.wsgi [None req-688c243b-12ef-432d-a8e2-2712d499f088 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] HTTP exception thrown: Instance 72245495-f5b8-4f54-8d17-ec3e700bdd9b could not be found. Jul 18 10:35:49.143204 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-688c243b-12ef-432d-a8e2-2712d499f088 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Request method failure captured: Jul 18 10:35:49.143204 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: request: DELETE /compute/v2.1/servers/72245495-f5b8-4f54-8d17-ec3e700bdd9b HTTP/1.1 Jul 18 10:35:49.143204 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: Accept: application/json Jul 18 10:35:49.143204 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: Accept-Encoding: identity Jul 18 10:35:49.143204 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: Connection: close Jul 18 10:35:49.143204 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: Content-Length: 0 Jul 18 10:35:49.143204 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: Content-Type: application/json Jul 18 10:35:49.143204 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: Host: 10.222.0.33 Jul 18 10:35:49.143204 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: Openstack-System-Scope: None Jul 18 10:35:49.143204 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: User-Agent: python-urllib3/1.26.9 Jul 18 10:35:49.143204 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Auth-Token: gAAAAABi1TXs5d9KA6TlIG1Li_VNjhkDxvVxs6ByaKH91Tp5cEYBI8OTiNSNI40UEe5MBLfNqlyuYAjUMpiV_qMg9jtmq9fJwxP3wvSLbrM9kN7Z4diK5bpD5WWlO_9PNIu02mzK2QxOqaTdn-MDBEh-IwIUUSwgtjyQOUrIhUK0fhFwotym42k Jul 18 10:35:49.143204 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Domain-Id: None Jul 18 10:35:49.143204 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Domain-Name: None Jul 18 10:35:49.143204 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Identity-Status: Confirmed Jul 18 10:35:49.143204 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Is-Admin-Project: True Jul 18 10:35:49.143204 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Project-Domain-Id: default Jul 18 10:35:49.143204 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Project-Domain-Name: Default Jul 18 10:35:49.143204 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Project-Id: 1cf3d5bfe9a745f38372c42c9cfa1f63 Jul 18 10:35:49.143204 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Project-Name: tempest-AttachVolumeNegativeTest-653274830 Jul 18 10:35:49.143204 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Role: member,reader Jul 18 10:35:49.143204 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Roles: member,reader Jul 18 10:35:49.144933 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1cf3d5bfe9a745f38372c42c9cfa1f63"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1cf3d5bfe9a745f38372c42c9cfa1f63"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/1cf3d5bfe9a745f38372c42c9cfa1f63"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_1cf3d5bfe9a745f38372c42c9cfa1f63"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jul 18 10:35:49.144933 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Tenant: tempest-AttachVolumeNegativeTest-653274830 Jul 18 10:35:49.144933 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Tenant-Id: 1cf3d5bfe9a745f38372c42c9cfa1f63 Jul 18 10:35:49.144933 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-653274830 Jul 18 10:35:49.144933 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-User: tempest-AttachVolumeNegativeTest-653274830-project Jul 18 10:35:49.144933 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-User-Domain-Id: default Jul 18 10:35:49.144933 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-User-Domain-Name: Default Jul 18 10:35:49.144933 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-User-Id: f25c72896a2d4d619e5ad4b5a0a79aa6 Jul 18 10:35:49.144933 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-User-Name: tempest-AttachVolumeNegativeTest-653274830-project Jul 18 10:35:49.144933 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: method: > Jul 18 10:35:49.144933 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: exception: Instance 72245495-f5b8-4f54-8d17-ec3e700bdd9b could not be found. Jul 18 10:35:49.144933 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: action_args: {'id': '72245495-f5b8-4f54-8d17-ec3e700bdd9b'} Jul 18 10:35:49.145902 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 10:35:49.145902 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:35:49.145902 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 10:35:49.145902 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 10:35:49.145902 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 10:35:49.145902 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 10:35:49.145902 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 10:35:49.145902 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 10:35:49.145902 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 10:35:49.145902 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 10:35:49.145902 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 72245495-f5b8-4f54-8d17-ec3e700bdd9b could not be found. Jul 18 10:35:49.145902 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi Jul 18 10:35:49.145902 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:35:49.145902 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi Jul 18 10:35:49.145902 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:35:49.145902 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:35:49.145902 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:35:49.145902 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 10:35:49.145902 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 10:35:49.145902 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 10:35:49.147422 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 10:35:49.147422 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 18 10:35:49.147422 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 18 10:35:49.147422 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 18 10:35:49.147422 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 18 10:35:49.147422 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 10:35:49.147422 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 10:35:49.147422 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 10:35:49.147422 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 10:35:49.147422 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 72245495-f5b8-4f54-8d17-ec3e700bdd9b could not be found. Jul 18 10:35:49.147422 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi Jul 18 10:35:49.147422 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:35:49.147422 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi Jul 18 10:35:49.147422 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:35:49.147422 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:35:49.147422 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:35:49.147422 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 10:35:49.147422 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 10:35:49.147422 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 72245495-f5b8-4f54-8d17-ec3e700bdd9b could not be found. Jul 18 10:35:49.147422 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi Jul 18 10:35:49.149052 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-688c243b-12ef-432d-a8e2-2712d499f088 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Returning 404 to user: Instance 72245495-f5b8-4f54-8d17-ec3e700bdd9b could not be found. {{(pid=117880) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 10:35:49.149052 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-688c243b-12ef-432d-a8e2-2712d499f088 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] 10.222.0.33 "DELETE /compute/v2.1/servers/72245495-f5b8-4f54-8d17-ec3e700bdd9b" status: 404 len: 111 microversion: 2.1 time: 0.048479 Jul 18 10:35:49.149052 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 437/877] 10.222.0.33 () {58 vars in 1238 bytes} [Mon Jul 18 10:35:49 2022] DELETE /compute/v2.1/servers/72245495-f5b8-4f54-8d17-ec3e700bdd9b => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 10:35:49.153589 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-de4f54de-15c5-4937-a166-17d9f7f9f59e tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:35:49.154200 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-de4f54de-15c5-4937-a166-17d9f7f9f59e tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] [instance: 72245495-f5b8-4f54-8d17-ec3e700bdd9b] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:35:49.160910 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-de4f54de-15c5-4937-a166-17d9f7f9f59e tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:35:49.161571 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-de4f54de-15c5-4937-a166-17d9f7f9f59e tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:35:49.162543 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-de4f54de-15c5-4937-a166-17d9f7f9f59e tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:35:49.162981 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-de4f54de-15c5-4937-a166-17d9f7f9f59e tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:35:49.177335 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.wsgi [None req-de4f54de-15c5-4937-a166-17d9f7f9f59e tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] HTTP exception thrown: Instance 72245495-f5b8-4f54-8d17-ec3e700bdd9b could not be found. Jul 18 10:35:49.179002 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-de4f54de-15c5-4937-a166-17d9f7f9f59e tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Request method failure captured: Jul 18 10:35:49.179002 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: request: GET /compute/v2.1/servers/72245495-f5b8-4f54-8d17-ec3e700bdd9b HTTP/1.1 Jul 18 10:35:49.179002 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: Accept: application/json Jul 18 10:35:49.179002 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: Accept-Encoding: identity Jul 18 10:35:49.179002 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: Connection: close Jul 18 10:35:49.179002 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: Content-Length: 0 Jul 18 10:35:49.179002 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: Content-Type: application/json Jul 18 10:35:49.179002 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: Host: 10.222.0.33 Jul 18 10:35:49.179002 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: Openstack-System-Scope: None Jul 18 10:35:49.179002 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: User-Agent: python-urllib3/1.26.9 Jul 18 10:35:49.179002 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Auth-Token: gAAAAABi1TXs5d9KA6TlIG1Li_VNjhkDxvVxs6ByaKH91Tp5cEYBI8OTiNSNI40UEe5MBLfNqlyuYAjUMpiV_qMg9jtmq9fJwxP3wvSLbrM9kN7Z4diK5bpD5WWlO_9PNIu02mzK2QxOqaTdn-MDBEh-IwIUUSwgtjyQOUrIhUK0fhFwotym42k Jul 18 10:35:49.179002 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Domain-Id: None Jul 18 10:35:49.179002 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Domain-Name: None Jul 18 10:35:49.179002 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Identity-Status: Confirmed Jul 18 10:35:49.179002 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Is-Admin-Project: True Jul 18 10:35:49.179002 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Project-Domain-Id: default Jul 18 10:35:49.179002 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Project-Domain-Name: Default Jul 18 10:35:49.179002 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Project-Id: 1cf3d5bfe9a745f38372c42c9cfa1f63 Jul 18 10:35:49.179002 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Project-Name: tempest-AttachVolumeNegativeTest-653274830 Jul 18 10:35:49.179002 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Role: member,reader Jul 18 10:35:49.179002 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Roles: member,reader Jul 18 10:35:49.180661 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1cf3d5bfe9a745f38372c42c9cfa1f63"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1cf3d5bfe9a745f38372c42c9cfa1f63"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/1cf3d5bfe9a745f38372c42c9cfa1f63"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_1cf3d5bfe9a745f38372c42c9cfa1f63"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jul 18 10:35:49.180661 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Tenant: tempest-AttachVolumeNegativeTest-653274830 Jul 18 10:35:49.180661 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Tenant-Id: 1cf3d5bfe9a745f38372c42c9cfa1f63 Jul 18 10:35:49.180661 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-653274830 Jul 18 10:35:49.180661 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-User: tempest-AttachVolumeNegativeTest-653274830-project Jul 18 10:35:49.180661 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-User-Domain-Id: default Jul 18 10:35:49.180661 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-User-Domain-Name: Default Jul 18 10:35:49.180661 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-User-Id: f25c72896a2d4d619e5ad4b5a0a79aa6 Jul 18 10:35:49.180661 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-User-Name: tempest-AttachVolumeNegativeTest-653274830-project Jul 18 10:35:49.180661 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: method: > Jul 18 10:35:49.180661 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: exception: Instance 72245495-f5b8-4f54-8d17-ec3e700bdd9b could not be found. Jul 18 10:35:49.180661 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: action_args: {'id': '72245495-f5b8-4f54-8d17-ec3e700bdd9b'} Jul 18 10:35:49.181839 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 10:35:49.181839 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:35:49.181839 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 10:35:49.181839 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 10:35:49.181839 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 10:35:49.181839 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 10:35:49.181839 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 10:35:49.181839 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 10:35:49.181839 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 10:35:49.181839 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 10:35:49.181839 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 72245495-f5b8-4f54-8d17-ec3e700bdd9b could not be found. Jul 18 10:35:49.181839 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi Jul 18 10:35:49.181839 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:35:49.181839 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi Jul 18 10:35:49.181839 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:35:49.181839 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:35:49.181839 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:35:49.181839 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 10:35:49.181839 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 10:35:49.181839 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 10:35:49.183447 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 10:35:49.183447 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 10:35:49.183447 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 10:35:49.183447 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 10:35:49.183447 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 10:35:49.183447 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 10:35:49.183447 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 10:35:49.183447 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 72245495-f5b8-4f54-8d17-ec3e700bdd9b could not be found. Jul 18 10:35:49.183447 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi Jul 18 10:35:49.183447 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:35:49.183447 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi Jul 18 10:35:49.183447 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:35:49.183447 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:35:49.183447 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:35:49.183447 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 10:35:49.183447 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 10:35:49.183447 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 72245495-f5b8-4f54-8d17-ec3e700bdd9b could not be found. Jul 18 10:35:49.183447 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi Jul 18 10:35:49.185131 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-de4f54de-15c5-4937-a166-17d9f7f9f59e tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Returning 404 to user: Instance 72245495-f5b8-4f54-8d17-ec3e700bdd9b could not be found. {{(pid=117879) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 10:35:49.185131 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-de4f54de-15c5-4937-a166-17d9f7f9f59e tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] 10.222.0.33 "GET /compute/v2.1/servers/72245495-f5b8-4f54-8d17-ec3e700bdd9b" status: 404 len: 111 microversion: 2.1 time: 0.030771 Jul 18 10:35:49.185131 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 441/878] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:35:49 2022] GET /compute/v2.1/servers/72245495-f5b8-4f54-8d17-ec3e700bdd9b => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 10:35:49.374070 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-a3e668aa-5169-4990-b1d3-ed922d492a4f tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:35:49.374635 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-a3e668aa-5169-4990-b1d3-ed922d492a4f tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] [instance: 9cdd676f-7b24-4c7e-849c-97e196465a3c] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:35:49.381522 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-a3e668aa-5169-4990-b1d3-ed922d492a4f tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:35:49.381977 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-a3e668aa-5169-4990-b1d3-ed922d492a4f tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:35:49.382975 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-a3e668aa-5169-4990-b1d3-ed922d492a4f tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:35:49.383420 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-a3e668aa-5169-4990-b1d3-ed922d492a4f tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:35:49.398427 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.wsgi [None req-a3e668aa-5169-4990-b1d3-ed922d492a4f tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] HTTP exception thrown: Instance 9cdd676f-7b24-4c7e-849c-97e196465a3c could not be found. Jul 18 10:35:49.400042 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-a3e668aa-5169-4990-b1d3-ed922d492a4f tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Request method failure captured: Jul 18 10:35:49.400042 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: request: DELETE /compute/v2.1/servers/9cdd676f-7b24-4c7e-849c-97e196465a3c HTTP/1.1 Jul 18 10:35:49.400042 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: Accept: application/json Jul 18 10:35:49.400042 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: Accept-Encoding: identity Jul 18 10:35:49.400042 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: Connection: close Jul 18 10:35:49.400042 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: Content-Length: 0 Jul 18 10:35:49.400042 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: Content-Type: application/json Jul 18 10:35:49.400042 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: Host: 10.222.0.33 Jul 18 10:35:49.400042 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: Openstack-System-Scope: None Jul 18 10:35:49.400042 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: User-Agent: python-urllib3/1.26.9 Jul 18 10:35:49.400042 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Auth-Token: gAAAAABi1TXyRuO93YpXTZGzpMcrXvlaMSRFZzr-AHOj2FRT2T5ihWk1lnTRwNGg9PrJbZQjx8rFUCx5FHM_0tuFNIv3bWjwRyt64fUTE1eFuCeWcTmRM14gEGuSdmP8w3Abds2w_lZwqjtKT13oQUVwIT92owvlu3szREV5s5g3P_QW6cRnhQU Jul 18 10:35:49.400042 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Domain-Id: None Jul 18 10:35:49.400042 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Domain-Name: None Jul 18 10:35:49.400042 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Identity-Status: Confirmed Jul 18 10:35:49.400042 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Is-Admin-Project: True Jul 18 10:35:49.400042 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Project-Domain-Id: default Jul 18 10:35:49.400042 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Project-Domain-Name: Default Jul 18 10:35:49.400042 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Project-Id: e6e487deb7ff45bdbf2cc002d42d12a5 Jul 18 10:35:49.400042 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Project-Name: tempest-AttachVolumeTestJSON-1614237976 Jul 18 10:35:49.400042 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Role: member,reader Jul 18 10:35:49.400042 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Roles: member,reader Jul 18 10:35:49.401756 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e6e487deb7ff45bdbf2cc002d42d12a5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e6e487deb7ff45bdbf2cc002d42d12a5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/e6e487deb7ff45bdbf2cc002d42d12a5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_e6e487deb7ff45bdbf2cc002d42d12a5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jul 18 10:35:49.401756 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Tenant: tempest-AttachVolumeTestJSON-1614237976 Jul 18 10:35:49.401756 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Tenant-Id: e6e487deb7ff45bdbf2cc002d42d12a5 Jul 18 10:35:49.401756 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1614237976 Jul 18 10:35:49.401756 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-User: tempest-AttachVolumeTestJSON-1614237976-project Jul 18 10:35:49.401756 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-User-Domain-Id: default Jul 18 10:35:49.401756 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-User-Domain-Name: Default Jul 18 10:35:49.401756 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-User-Id: 986f90dfbad14324b3fffbd790d60a37 Jul 18 10:35:49.401756 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-User-Name: tempest-AttachVolumeTestJSON-1614237976-project Jul 18 10:35:49.401756 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: method: > Jul 18 10:35:49.401756 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: exception: Instance 9cdd676f-7b24-4c7e-849c-97e196465a3c could not be found. Jul 18 10:35:49.401756 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: action_args: {'id': '9cdd676f-7b24-4c7e-849c-97e196465a3c'} Jul 18 10:35:49.402751 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 10:35:49.402751 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:35:49.402751 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 10:35:49.402751 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 10:35:49.402751 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 10:35:49.402751 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 10:35:49.402751 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 10:35:49.402751 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 10:35:49.402751 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 10:35:49.402751 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 10:35:49.402751 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9cdd676f-7b24-4c7e-849c-97e196465a3c could not be found. Jul 18 10:35:49.402751 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi Jul 18 10:35:49.402751 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:35:49.402751 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi Jul 18 10:35:49.402751 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:35:49.402751 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:35:49.402751 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:35:49.402751 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 10:35:49.402751 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 10:35:49.402751 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 10:35:49.404889 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 10:35:49.404889 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 18 10:35:49.404889 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 18 10:35:49.404889 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 18 10:35:49.404889 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 18 10:35:49.404889 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 10:35:49.404889 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 10:35:49.404889 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 10:35:49.404889 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 10:35:49.404889 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9cdd676f-7b24-4c7e-849c-97e196465a3c could not be found. Jul 18 10:35:49.404889 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi Jul 18 10:35:49.404889 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:35:49.404889 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi Jul 18 10:35:49.404889 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:35:49.404889 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:35:49.404889 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:35:49.404889 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 10:35:49.404889 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 10:35:49.404889 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9cdd676f-7b24-4c7e-849c-97e196465a3c could not be found. Jul 18 10:35:49.404889 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi Jul 18 10:35:49.407774 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-a3e668aa-5169-4990-b1d3-ed922d492a4f tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Returning 404 to user: Instance 9cdd676f-7b24-4c7e-849c-97e196465a3c could not be found. {{(pid=117880) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 10:35:49.409346 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-a3e668aa-5169-4990-b1d3-ed922d492a4f tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] 10.222.0.33 "DELETE /compute/v2.1/servers/9cdd676f-7b24-4c7e-849c-97e196465a3c" status: 404 len: 111 microversion: 2.1 time: 0.039099 Jul 18 10:35:49.409902 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 438/879] 10.222.0.33 () {58 vars in 1238 bytes} [Mon Jul 18 10:35:49 2022] DELETE /compute/v2.1/servers/9cdd676f-7b24-4c7e-849c-97e196465a3c => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 10:35:49.423228 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-110c671b-c448-4d4e-8bf8-613273a33e7e tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:35:49.424104 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-110c671b-c448-4d4e-8bf8-613273a33e7e tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] [instance: 9cdd676f-7b24-4c7e-849c-97e196465a3c] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:35:49.435380 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-110c671b-c448-4d4e-8bf8-613273a33e7e tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:35:49.435917 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-110c671b-c448-4d4e-8bf8-613273a33e7e tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:35:49.437462 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-110c671b-c448-4d4e-8bf8-613273a33e7e tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:35:49.438312 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-110c671b-c448-4d4e-8bf8-613273a33e7e tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:35:49.456197 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.wsgi [None req-110c671b-c448-4d4e-8bf8-613273a33e7e tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] HTTP exception thrown: Instance 9cdd676f-7b24-4c7e-849c-97e196465a3c could not be found. Jul 18 10:35:49.458351 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-110c671b-c448-4d4e-8bf8-613273a33e7e tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Request method failure captured: Jul 18 10:35:49.458351 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: request: GET /compute/v2.1/servers/9cdd676f-7b24-4c7e-849c-97e196465a3c HTTP/1.1 Jul 18 10:35:49.458351 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: Accept: application/json Jul 18 10:35:49.458351 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: Accept-Encoding: identity Jul 18 10:35:49.458351 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: Connection: close Jul 18 10:35:49.458351 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: Content-Length: 0 Jul 18 10:35:49.458351 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: Content-Type: application/json Jul 18 10:35:49.458351 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: Host: 10.222.0.33 Jul 18 10:35:49.458351 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: Openstack-System-Scope: None Jul 18 10:35:49.458351 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: User-Agent: python-urllib3/1.26.9 Jul 18 10:35:49.458351 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Auth-Token: gAAAAABi1TXyRuO93YpXTZGzpMcrXvlaMSRFZzr-AHOj2FRT2T5ihWk1lnTRwNGg9PrJbZQjx8rFUCx5FHM_0tuFNIv3bWjwRyt64fUTE1eFuCeWcTmRM14gEGuSdmP8w3Abds2w_lZwqjtKT13oQUVwIT92owvlu3szREV5s5g3P_QW6cRnhQU Jul 18 10:35:49.458351 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Domain-Id: None Jul 18 10:35:49.458351 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Domain-Name: None Jul 18 10:35:49.458351 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Identity-Status: Confirmed Jul 18 10:35:49.458351 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Is-Admin-Project: True Jul 18 10:35:49.458351 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Project-Domain-Id: default Jul 18 10:35:49.458351 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Project-Domain-Name: Default Jul 18 10:35:49.458351 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Project-Id: e6e487deb7ff45bdbf2cc002d42d12a5 Jul 18 10:35:49.458351 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Project-Name: tempest-AttachVolumeTestJSON-1614237976 Jul 18 10:35:49.458351 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Role: member,reader Jul 18 10:35:49.458351 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Roles: member,reader Jul 18 10:35:49.459798 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e6e487deb7ff45bdbf2cc002d42d12a5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e6e487deb7ff45bdbf2cc002d42d12a5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/e6e487deb7ff45bdbf2cc002d42d12a5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_e6e487deb7ff45bdbf2cc002d42d12a5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jul 18 10:35:49.459798 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Tenant: tempest-AttachVolumeTestJSON-1614237976 Jul 18 10:35:49.459798 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Tenant-Id: e6e487deb7ff45bdbf2cc002d42d12a5 Jul 18 10:35:49.459798 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1614237976 Jul 18 10:35:49.459798 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-User: tempest-AttachVolumeTestJSON-1614237976-project Jul 18 10:35:49.459798 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-User-Domain-Id: default Jul 18 10:35:49.459798 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-User-Domain-Name: Default Jul 18 10:35:49.459798 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-User-Id: 986f90dfbad14324b3fffbd790d60a37 Jul 18 10:35:49.459798 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-User-Name: tempest-AttachVolumeTestJSON-1614237976-project Jul 18 10:35:49.459798 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: method: > Jul 18 10:35:49.459798 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: exception: Instance 9cdd676f-7b24-4c7e-849c-97e196465a3c could not be found. Jul 18 10:35:49.459798 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: action_args: {'id': '9cdd676f-7b24-4c7e-849c-97e196465a3c'} Jul 18 10:35:49.460622 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 10:35:49.460622 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:35:49.460622 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 10:35:49.460622 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 10:35:49.460622 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 10:35:49.460622 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 10:35:49.460622 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 10:35:49.460622 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 10:35:49.460622 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 10:35:49.460622 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 10:35:49.460622 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9cdd676f-7b24-4c7e-849c-97e196465a3c could not be found. Jul 18 10:35:49.460622 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi Jul 18 10:35:49.460622 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:35:49.460622 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi Jul 18 10:35:49.460622 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:35:49.460622 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:35:49.460622 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:35:49.460622 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 10:35:49.460622 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 10:35:49.460622 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 10:35:49.461946 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 10:35:49.461946 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 10:35:49.461946 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 10:35:49.461946 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 10:35:49.461946 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 10:35:49.461946 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 10:35:49.461946 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 10:35:49.461946 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9cdd676f-7b24-4c7e-849c-97e196465a3c could not be found. Jul 18 10:35:49.461946 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi Jul 18 10:35:49.461946 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:35:49.461946 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi Jul 18 10:35:49.461946 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:35:49.461946 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:35:49.461946 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:35:49.461946 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 10:35:49.461946 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 10:35:49.461946 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9cdd676f-7b24-4c7e-849c-97e196465a3c could not be found. Jul 18 10:35:49.461946 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi Jul 18 10:35:49.463229 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-110c671b-c448-4d4e-8bf8-613273a33e7e tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Returning 404 to user: Instance 9cdd676f-7b24-4c7e-849c-97e196465a3c could not be found. {{(pid=117879) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 10:35:49.463229 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-110c671b-c448-4d4e-8bf8-613273a33e7e tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] 10.222.0.33 "GET /compute/v2.1/servers/9cdd676f-7b24-4c7e-849c-97e196465a3c" status: 404 len: 111 microversion: 2.1 time: 0.045751 Jul 18 10:35:49.463229 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 442/880] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:35:49 2022] GET /compute/v2.1/servers/9cdd676f-7b24-4c7e-849c-97e196465a3c => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 18 10:35:50.117104 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-630fb169-5b68-495e-9a34-2bb5d45a2095 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:35:50.118954 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-630fb169-5b68-495e-9a34-2bb5d45a2095 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] [instance: b1a84290-3520-427e-af49-f380d2a144bb] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:35:50.133353 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-630fb169-5b68-495e-9a34-2bb5d45a2095 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:35:50.135790 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-630fb169-5b68-495e-9a34-2bb5d45a2095 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:35:50.136960 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-630fb169-5b68-495e-9a34-2bb5d45a2095 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:35:50.146214 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-630fb169-5b68-495e-9a34-2bb5d45a2095 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:35:50.322890 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-630fb169-5b68-495e-9a34-2bb5d45a2095 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:35:50.335862 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-630fb169-5b68-495e-9a34-2bb5d45a2095 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:35:50.338479 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-630fb169-5b68-495e-9a34-2bb5d45a2095 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:35:50.343743 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-630fb169-5b68-495e-9a34-2bb5d45a2095 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] 10.222.0.33 "GET /compute/v2.1/servers/b1a84290-3520-427e-af49-f380d2a144bb" status: 200 len: 1809 microversion: 2.20 time: 0.230214 Jul 18 10:35:50.345758 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 439/881] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jul 18 10:35:50 2022] GET /compute/v2.1/servers/b1a84290-3520-427e-af49-f380d2a144bb => generated 1809 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:35:50.350937 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-b19e93b0-e834-4eee-8a59-c9e3f546d048 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:35:50.351812 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-b19e93b0-e834-4eee-8a59-c9e3f546d048 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] [instance: 54754961-403d-4f99-98c1-727db8528d91] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:35:50.362624 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-b19e93b0-e834-4eee-8a59-c9e3f546d048 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:35:50.365018 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-b19e93b0-e834-4eee-8a59-c9e3f546d048 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:35:50.367569 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-b19e93b0-e834-4eee-8a59-c9e3f546d048 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:35:50.369707 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-b19e93b0-e834-4eee-8a59-c9e3f546d048 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:35:50.393433 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.wsgi [None req-b19e93b0-e834-4eee-8a59-c9e3f546d048 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] HTTP exception thrown: Instance 54754961-403d-4f99-98c1-727db8528d91 could not be found. Jul 18 10:35:50.400279 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-b19e93b0-e834-4eee-8a59-c9e3f546d048 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Request method failure captured: Jul 18 10:35:50.400279 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: request: DELETE /compute/v2.1/servers/54754961-403d-4f99-98c1-727db8528d91 HTTP/1.1 Jul 18 10:35:50.400279 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: Accept: application/json Jul 18 10:35:50.400279 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: Accept-Encoding: identity Jul 18 10:35:50.400279 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: Connection: close Jul 18 10:35:50.400279 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: Content-Length: 0 Jul 18 10:35:50.400279 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: Content-Type: application/json Jul 18 10:35:50.400279 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: Host: 10.222.0.33 Jul 18 10:35:50.400279 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: Openstack-System-Scope: None Jul 18 10:35:50.400279 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: User-Agent: python-urllib3/1.26.9 Jul 18 10:35:50.400279 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Auth-Token: gAAAAABi1TXs5d9KA6TlIG1Li_VNjhkDxvVxs6ByaKH91Tp5cEYBI8OTiNSNI40UEe5MBLfNqlyuYAjUMpiV_qMg9jtmq9fJwxP3wvSLbrM9kN7Z4diK5bpD5WWlO_9PNIu02mzK2QxOqaTdn-MDBEh-IwIUUSwgtjyQOUrIhUK0fhFwotym42k Jul 18 10:35:50.400279 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Domain-Id: None Jul 18 10:35:50.400279 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Domain-Name: None Jul 18 10:35:50.400279 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Identity-Status: Confirmed Jul 18 10:35:50.400279 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Is-Admin-Project: True Jul 18 10:35:50.400279 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Project-Domain-Id: default Jul 18 10:35:50.400279 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Project-Domain-Name: Default Jul 18 10:35:50.400279 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Project-Id: 1cf3d5bfe9a745f38372c42c9cfa1f63 Jul 18 10:35:50.400279 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Project-Name: tempest-AttachVolumeNegativeTest-653274830 Jul 18 10:35:50.400279 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Role: member,reader Jul 18 10:35:50.400279 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Roles: member,reader Jul 18 10:35:50.401826 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1cf3d5bfe9a745f38372c42c9cfa1f63"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1cf3d5bfe9a745f38372c42c9cfa1f63"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/1cf3d5bfe9a745f38372c42c9cfa1f63"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_1cf3d5bfe9a745f38372c42c9cfa1f63"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jul 18 10:35:50.401826 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Tenant: tempest-AttachVolumeNegativeTest-653274830 Jul 18 10:35:50.401826 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Tenant-Id: 1cf3d5bfe9a745f38372c42c9cfa1f63 Jul 18 10:35:50.401826 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-653274830 Jul 18 10:35:50.401826 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-User: tempest-AttachVolumeNegativeTest-653274830-project Jul 18 10:35:50.401826 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-User-Domain-Id: default Jul 18 10:35:50.401826 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-User-Domain-Name: Default Jul 18 10:35:50.401826 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-User-Id: f25c72896a2d4d619e5ad4b5a0a79aa6 Jul 18 10:35:50.401826 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-User-Name: tempest-AttachVolumeNegativeTest-653274830-project Jul 18 10:35:50.401826 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: method: > Jul 18 10:35:50.401826 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: exception: Instance 54754961-403d-4f99-98c1-727db8528d91 could not be found. Jul 18 10:35:50.401826 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: action_args: {'id': '54754961-403d-4f99-98c1-727db8528d91'} Jul 18 10:35:50.402818 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 10:35:50.402818 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:35:50.402818 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 10:35:50.402818 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 10:35:50.402818 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 10:35:50.402818 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 10:35:50.402818 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 10:35:50.402818 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 10:35:50.402818 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 10:35:50.402818 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 10:35:50.402818 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 54754961-403d-4f99-98c1-727db8528d91 could not be found. Jul 18 10:35:50.402818 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi Jul 18 10:35:50.402818 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:35:50.402818 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi Jul 18 10:35:50.402818 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:35:50.402818 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:35:50.402818 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:35:50.402818 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 10:35:50.402818 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 10:35:50.402818 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 10:35:50.404194 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 10:35:50.404194 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 18 10:35:50.404194 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 18 10:35:50.404194 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 18 10:35:50.404194 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 18 10:35:50.404194 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 10:35:50.404194 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 10:35:50.404194 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 10:35:50.404194 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 10:35:50.404194 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 54754961-403d-4f99-98c1-727db8528d91 could not be found. Jul 18 10:35:50.404194 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi Jul 18 10:35:50.404194 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:35:50.404194 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi Jul 18 10:35:50.404194 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:35:50.404194 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:35:50.404194 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:35:50.404194 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 10:35:50.404194 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 10:35:50.404194 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 54754961-403d-4f99-98c1-727db8528d91 could not be found. Jul 18 10:35:50.404194 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi Jul 18 10:35:50.410125 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-b19e93b0-e834-4eee-8a59-c9e3f546d048 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Returning 404 to user: Instance 54754961-403d-4f99-98c1-727db8528d91 could not be found. {{(pid=117879) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 10:35:50.416614 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-b19e93b0-e834-4eee-8a59-c9e3f546d048 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] 10.222.0.33 "DELETE /compute/v2.1/servers/54754961-403d-4f99-98c1-727db8528d91" status: 404 len: 111 microversion: 2.1 time: 0.069574 Jul 18 10:35:50.417497 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 443/882] 10.222.0.33 () {58 vars in 1238 bytes} [Mon Jul 18 10:35:50 2022] DELETE /compute/v2.1/servers/54754961-403d-4f99-98c1-727db8528d91 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 18 10:35:50.434588 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-1b39d543-6010-4f6f-9f92-a1bdab315e96 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:35:50.436018 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-1b39d543-6010-4f6f-9f92-a1bdab315e96 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] [instance: 54754961-403d-4f99-98c1-727db8528d91] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:35:50.452798 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-1b39d543-6010-4f6f-9f92-a1bdab315e96 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:35:50.454163 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-1b39d543-6010-4f6f-9f92-a1bdab315e96 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:35:50.456374 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-1b39d543-6010-4f6f-9f92-a1bdab315e96 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:35:50.458755 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-1b39d543-6010-4f6f-9f92-a1bdab315e96 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:35:50.488531 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.wsgi [None req-1b39d543-6010-4f6f-9f92-a1bdab315e96 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] HTTP exception thrown: Instance 54754961-403d-4f99-98c1-727db8528d91 could not be found. Jul 18 10:35:50.491948 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-1b39d543-6010-4f6f-9f92-a1bdab315e96 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Request method failure captured: Jul 18 10:35:50.491948 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: request: GET /compute/v2.1/servers/54754961-403d-4f99-98c1-727db8528d91 HTTP/1.1 Jul 18 10:35:50.491948 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: Accept: application/json Jul 18 10:35:50.491948 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: Accept-Encoding: identity Jul 18 10:35:50.491948 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: Connection: close Jul 18 10:35:50.491948 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: Content-Length: 0 Jul 18 10:35:50.491948 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: Content-Type: application/json Jul 18 10:35:50.491948 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: Host: 10.222.0.33 Jul 18 10:35:50.491948 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: Openstack-System-Scope: None Jul 18 10:35:50.491948 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: User-Agent: python-urllib3/1.26.9 Jul 18 10:35:50.491948 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Auth-Token: gAAAAABi1TXs5d9KA6TlIG1Li_VNjhkDxvVxs6ByaKH91Tp5cEYBI8OTiNSNI40UEe5MBLfNqlyuYAjUMpiV_qMg9jtmq9fJwxP3wvSLbrM9kN7Z4diK5bpD5WWlO_9PNIu02mzK2QxOqaTdn-MDBEh-IwIUUSwgtjyQOUrIhUK0fhFwotym42k Jul 18 10:35:50.491948 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Domain-Id: None Jul 18 10:35:50.491948 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Domain-Name: None Jul 18 10:35:50.491948 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Identity-Status: Confirmed Jul 18 10:35:50.491948 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Is-Admin-Project: True Jul 18 10:35:50.491948 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Project-Domain-Id: default Jul 18 10:35:50.491948 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Project-Domain-Name: Default Jul 18 10:35:50.491948 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Project-Id: 1cf3d5bfe9a745f38372c42c9cfa1f63 Jul 18 10:35:50.491948 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Project-Name: tempest-AttachVolumeNegativeTest-653274830 Jul 18 10:35:50.491948 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Role: member,reader Jul 18 10:35:50.491948 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Roles: member,reader Jul 18 10:35:50.493587 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1cf3d5bfe9a745f38372c42c9cfa1f63"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1cf3d5bfe9a745f38372c42c9cfa1f63"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/1cf3d5bfe9a745f38372c42c9cfa1f63"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_1cf3d5bfe9a745f38372c42c9cfa1f63"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jul 18 10:35:50.493587 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Tenant: tempest-AttachVolumeNegativeTest-653274830 Jul 18 10:35:50.493587 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Tenant-Id: 1cf3d5bfe9a745f38372c42c9cfa1f63 Jul 18 10:35:50.493587 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-653274830 Jul 18 10:35:50.493587 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-User: tempest-AttachVolumeNegativeTest-653274830-project Jul 18 10:35:50.493587 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-User-Domain-Id: default Jul 18 10:35:50.493587 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-User-Domain-Name: Default Jul 18 10:35:50.493587 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-User-Id: f25c72896a2d4d619e5ad4b5a0a79aa6 Jul 18 10:35:50.493587 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-User-Name: tempest-AttachVolumeNegativeTest-653274830-project Jul 18 10:35:50.493587 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: method: > Jul 18 10:35:50.493587 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: exception: Instance 54754961-403d-4f99-98c1-727db8528d91 could not be found. Jul 18 10:35:50.493587 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: action_args: {'id': '54754961-403d-4f99-98c1-727db8528d91'} Jul 18 10:35:50.494502 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 10:35:50.494502 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:35:50.494502 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 10:35:50.494502 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 10:35:50.494502 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 10:35:50.494502 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 10:35:50.494502 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 10:35:50.494502 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 10:35:50.494502 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 10:35:50.494502 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 10:35:50.494502 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 54754961-403d-4f99-98c1-727db8528d91 could not be found. Jul 18 10:35:50.494502 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi Jul 18 10:35:50.494502 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:35:50.494502 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi Jul 18 10:35:50.494502 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:35:50.494502 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:35:50.494502 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:35:50.494502 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 10:35:50.494502 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 10:35:50.494502 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 10:35:50.495989 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 10:35:50.495989 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 10:35:50.495989 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 10:35:50.495989 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 10:35:50.495989 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 10:35:50.495989 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 10:35:50.495989 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 10:35:50.495989 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 54754961-403d-4f99-98c1-727db8528d91 could not be found. Jul 18 10:35:50.495989 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi Jul 18 10:35:50.495989 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:35:50.495989 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi Jul 18 10:35:50.495989 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:35:50.495989 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:35:50.495989 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:35:50.495989 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 10:35:50.495989 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 10:35:50.495989 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 54754961-403d-4f99-98c1-727db8528d91 could not be found. Jul 18 10:35:50.495989 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi Jul 18 10:35:50.497347 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-1b39d543-6010-4f6f-9f92-a1bdab315e96 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Returning 404 to user: Instance 54754961-403d-4f99-98c1-727db8528d91 could not be found. {{(pid=117880) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 10:35:50.498533 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-1b39d543-6010-4f6f-9f92-a1bdab315e96 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] 10.222.0.33 "GET /compute/v2.1/servers/54754961-403d-4f99-98c1-727db8528d91" status: 404 len: 111 microversion: 2.1 time: 0.076040 Jul 18 10:35:50.502436 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 440/883] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:35:50 2022] GET /compute/v2.1/servers/54754961-403d-4f99-98c1-727db8528d91 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 10:35:50.508142 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-34faaece-a44d-4bcb-9e82-5b7f78c44bdf tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:35:50.508956 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-34faaece-a44d-4bcb-9e82-5b7f78c44bdf tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] [instance: 1e3ca3fe-e03a-47e3-9d9c-a6ab431e2dd7] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:35:50.524131 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-34faaece-a44d-4bcb-9e82-5b7f78c44bdf tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:35:50.524895 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-34faaece-a44d-4bcb-9e82-5b7f78c44bdf tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:35:50.525840 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-34faaece-a44d-4bcb-9e82-5b7f78c44bdf tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:35:50.526440 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-34faaece-a44d-4bcb-9e82-5b7f78c44bdf tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:35:50.545608 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.wsgi [None req-34faaece-a44d-4bcb-9e82-5b7f78c44bdf tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] HTTP exception thrown: Instance 1e3ca3fe-e03a-47e3-9d9c-a6ab431e2dd7 could not be found. Jul 18 10:35:50.548246 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-34faaece-a44d-4bcb-9e82-5b7f78c44bdf tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Request method failure captured: Jul 18 10:35:50.548246 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: request: DELETE /compute/v2.1/servers/1e3ca3fe-e03a-47e3-9d9c-a6ab431e2dd7 HTTP/1.1 Jul 18 10:35:50.548246 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: Accept: application/json Jul 18 10:35:50.548246 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: Accept-Encoding: identity Jul 18 10:35:50.548246 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: Connection: close Jul 18 10:35:50.548246 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: Content-Length: 0 Jul 18 10:35:50.548246 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: Content-Type: application/json Jul 18 10:35:50.548246 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: Host: 10.222.0.33 Jul 18 10:35:50.548246 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: Openstack-System-Scope: None Jul 18 10:35:50.548246 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: User-Agent: python-urllib3/1.26.9 Jul 18 10:35:50.548246 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Auth-Token: gAAAAABi1TXs5d9KA6TlIG1Li_VNjhkDxvVxs6ByaKH91Tp5cEYBI8OTiNSNI40UEe5MBLfNqlyuYAjUMpiV_qMg9jtmq9fJwxP3wvSLbrM9kN7Z4diK5bpD5WWlO_9PNIu02mzK2QxOqaTdn-MDBEh-IwIUUSwgtjyQOUrIhUK0fhFwotym42k Jul 18 10:35:50.548246 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Domain-Id: None Jul 18 10:35:50.548246 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Domain-Name: None Jul 18 10:35:50.548246 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Identity-Status: Confirmed Jul 18 10:35:50.548246 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Is-Admin-Project: True Jul 18 10:35:50.548246 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Project-Domain-Id: default Jul 18 10:35:50.548246 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Project-Domain-Name: Default Jul 18 10:35:50.548246 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Project-Id: 1cf3d5bfe9a745f38372c42c9cfa1f63 Jul 18 10:35:50.548246 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Project-Name: tempest-AttachVolumeNegativeTest-653274830 Jul 18 10:35:50.548246 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Role: member,reader Jul 18 10:35:50.548246 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Roles: member,reader Jul 18 10:35:50.549658 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1cf3d5bfe9a745f38372c42c9cfa1f63"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1cf3d5bfe9a745f38372c42c9cfa1f63"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/1cf3d5bfe9a745f38372c42c9cfa1f63"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_1cf3d5bfe9a745f38372c42c9cfa1f63"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jul 18 10:35:50.549658 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Tenant: tempest-AttachVolumeNegativeTest-653274830 Jul 18 10:35:50.549658 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Tenant-Id: 1cf3d5bfe9a745f38372c42c9cfa1f63 Jul 18 10:35:50.549658 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-653274830 Jul 18 10:35:50.549658 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-User: tempest-AttachVolumeNegativeTest-653274830-project Jul 18 10:35:50.549658 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-User-Domain-Id: default Jul 18 10:35:50.549658 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-User-Domain-Name: Default Jul 18 10:35:50.549658 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-User-Id: f25c72896a2d4d619e5ad4b5a0a79aa6 Jul 18 10:35:50.549658 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-User-Name: tempest-AttachVolumeNegativeTest-653274830-project Jul 18 10:35:50.549658 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: method: > Jul 18 10:35:50.549658 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: exception: Instance 1e3ca3fe-e03a-47e3-9d9c-a6ab431e2dd7 could not be found. Jul 18 10:35:50.549658 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: action_args: {'id': '1e3ca3fe-e03a-47e3-9d9c-a6ab431e2dd7'} Jul 18 10:35:50.550406 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 10:35:50.550406 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:35:50.550406 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 10:35:50.550406 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 10:35:50.550406 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 10:35:50.550406 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 10:35:50.550406 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 10:35:50.550406 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 10:35:50.550406 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 10:35:50.550406 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 10:35:50.550406 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1e3ca3fe-e03a-47e3-9d9c-a6ab431e2dd7 could not be found. Jul 18 10:35:50.550406 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi Jul 18 10:35:50.550406 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:35:50.550406 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi Jul 18 10:35:50.550406 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:35:50.550406 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:35:50.550406 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:35:50.550406 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 10:35:50.550406 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 10:35:50.550406 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 10:35:50.553141 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 10:35:50.553141 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 18 10:35:50.553141 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 18 10:35:50.553141 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 18 10:35:50.553141 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 18 10:35:50.553141 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 10:35:50.553141 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 10:35:50.553141 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 10:35:50.553141 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 10:35:50.553141 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1e3ca3fe-e03a-47e3-9d9c-a6ab431e2dd7 could not be found. Jul 18 10:35:50.553141 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi Jul 18 10:35:50.553141 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:35:50.553141 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi Jul 18 10:35:50.553141 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:35:50.553141 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:35:50.553141 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:35:50.553141 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 10:35:50.553141 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 10:35:50.553141 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1e3ca3fe-e03a-47e3-9d9c-a6ab431e2dd7 could not be found. Jul 18 10:35:50.553141 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi Jul 18 10:35:50.556891 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-34faaece-a44d-4bcb-9e82-5b7f78c44bdf tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Returning 404 to user: Instance 1e3ca3fe-e03a-47e3-9d9c-a6ab431e2dd7 could not be found. {{(pid=117879) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 10:35:50.558467 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-34faaece-a44d-4bcb-9e82-5b7f78c44bdf tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] 10.222.0.33 "DELETE /compute/v2.1/servers/1e3ca3fe-e03a-47e3-9d9c-a6ab431e2dd7" status: 404 len: 111 microversion: 2.1 time: 0.054154 Jul 18 10:35:50.559450 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 444/884] 10.222.0.33 () {58 vars in 1238 bytes} [Mon Jul 18 10:35:50 2022] DELETE /compute/v2.1/servers/1e3ca3fe-e03a-47e3-9d9c-a6ab431e2dd7 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 18 10:35:50.568663 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-5a25252b-53d2-452b-9880-8f72532290c4 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:35:50.569344 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-5a25252b-53d2-452b-9880-8f72532290c4 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] [instance: 1e3ca3fe-e03a-47e3-9d9c-a6ab431e2dd7] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:35:50.583474 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-5a25252b-53d2-452b-9880-8f72532290c4 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:35:50.583928 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-5a25252b-53d2-452b-9880-8f72532290c4 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:35:50.584774 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-5a25252b-53d2-452b-9880-8f72532290c4 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:35:50.585397 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-5a25252b-53d2-452b-9880-8f72532290c4 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:35:50.605972 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.wsgi [None req-5a25252b-53d2-452b-9880-8f72532290c4 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] HTTP exception thrown: Instance 1e3ca3fe-e03a-47e3-9d9c-a6ab431e2dd7 could not be found. Jul 18 10:35:50.608071 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-5a25252b-53d2-452b-9880-8f72532290c4 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Request method failure captured: Jul 18 10:35:50.608071 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: request: GET /compute/v2.1/servers/1e3ca3fe-e03a-47e3-9d9c-a6ab431e2dd7 HTTP/1.1 Jul 18 10:35:50.608071 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: Accept: application/json Jul 18 10:35:50.608071 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: Accept-Encoding: identity Jul 18 10:35:50.608071 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: Connection: close Jul 18 10:35:50.608071 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: Content-Length: 0 Jul 18 10:35:50.608071 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: Content-Type: application/json Jul 18 10:35:50.608071 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: Host: 10.222.0.33 Jul 18 10:35:50.608071 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: Openstack-System-Scope: None Jul 18 10:35:50.608071 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: User-Agent: python-urllib3/1.26.9 Jul 18 10:35:50.608071 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Auth-Token: gAAAAABi1TXs5d9KA6TlIG1Li_VNjhkDxvVxs6ByaKH91Tp5cEYBI8OTiNSNI40UEe5MBLfNqlyuYAjUMpiV_qMg9jtmq9fJwxP3wvSLbrM9kN7Z4diK5bpD5WWlO_9PNIu02mzK2QxOqaTdn-MDBEh-IwIUUSwgtjyQOUrIhUK0fhFwotym42k Jul 18 10:35:50.608071 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Domain-Id: None Jul 18 10:35:50.608071 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Domain-Name: None Jul 18 10:35:50.608071 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Identity-Status: Confirmed Jul 18 10:35:50.608071 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Is-Admin-Project: True Jul 18 10:35:50.608071 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Project-Domain-Id: default Jul 18 10:35:50.608071 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Project-Domain-Name: Default Jul 18 10:35:50.608071 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Project-Id: 1cf3d5bfe9a745f38372c42c9cfa1f63 Jul 18 10:35:50.608071 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Project-Name: tempest-AttachVolumeNegativeTest-653274830 Jul 18 10:35:50.608071 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Role: member,reader Jul 18 10:35:50.608071 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Roles: member,reader Jul 18 10:35:50.609602 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1cf3d5bfe9a745f38372c42c9cfa1f63"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1cf3d5bfe9a745f38372c42c9cfa1f63"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/1cf3d5bfe9a745f38372c42c9cfa1f63"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_1cf3d5bfe9a745f38372c42c9cfa1f63"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jul 18 10:35:50.609602 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Tenant: tempest-AttachVolumeNegativeTest-653274830 Jul 18 10:35:50.609602 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Tenant-Id: 1cf3d5bfe9a745f38372c42c9cfa1f63 Jul 18 10:35:50.609602 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-653274830 Jul 18 10:35:50.609602 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-User: tempest-AttachVolumeNegativeTest-653274830-project Jul 18 10:35:50.609602 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-User-Domain-Id: default Jul 18 10:35:50.609602 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-User-Domain-Name: Default Jul 18 10:35:50.609602 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-User-Id: f25c72896a2d4d619e5ad4b5a0a79aa6 Jul 18 10:35:50.609602 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-User-Name: tempest-AttachVolumeNegativeTest-653274830-project Jul 18 10:35:50.609602 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: method: > Jul 18 10:35:50.609602 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: exception: Instance 1e3ca3fe-e03a-47e3-9d9c-a6ab431e2dd7 could not be found. Jul 18 10:35:50.609602 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: action_args: {'id': '1e3ca3fe-e03a-47e3-9d9c-a6ab431e2dd7'} Jul 18 10:35:50.610445 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 10:35:50.610445 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:35:50.610445 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 10:35:50.610445 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 10:35:50.610445 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 10:35:50.610445 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 10:35:50.610445 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 10:35:50.610445 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 10:35:50.610445 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 10:35:50.610445 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 10:35:50.610445 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1e3ca3fe-e03a-47e3-9d9c-a6ab431e2dd7 could not be found. Jul 18 10:35:50.610445 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi Jul 18 10:35:50.610445 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:35:50.610445 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi Jul 18 10:35:50.610445 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:35:50.610445 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:35:50.610445 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:35:50.610445 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 10:35:50.610445 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 10:35:50.610445 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 10:35:50.611801 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 10:35:50.611801 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 10:35:50.611801 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 10:35:50.611801 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 10:35:50.611801 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 10:35:50.611801 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 10:35:50.611801 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 10:35:50.611801 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1e3ca3fe-e03a-47e3-9d9c-a6ab431e2dd7 could not be found. Jul 18 10:35:50.611801 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi Jul 18 10:35:50.611801 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:35:50.611801 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi Jul 18 10:35:50.611801 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:35:50.611801 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:35:50.611801 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:35:50.611801 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 10:35:50.611801 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 10:35:50.611801 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1e3ca3fe-e03a-47e3-9d9c-a6ab431e2dd7 could not be found. Jul 18 10:35:50.611801 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi Jul 18 10:35:50.615077 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-5a25252b-53d2-452b-9880-8f72532290c4 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Returning 404 to user: Instance 1e3ca3fe-e03a-47e3-9d9c-a6ab431e2dd7 could not be found. {{(pid=117880) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 10:35:50.616150 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-5a25252b-53d2-452b-9880-8f72532290c4 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] 10.222.0.33 "GET /compute/v2.1/servers/1e3ca3fe-e03a-47e3-9d9c-a6ab431e2dd7" status: 404 len: 111 microversion: 2.1 time: 0.052317 Jul 18 10:35:50.617251 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 441/885] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:35:50 2022] GET /compute/v2.1/servers/1e3ca3fe-e03a-47e3-9d9c-a6ab431e2dd7 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 18 10:35:50.655102 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-c4b20f96-1ba8-4fff-898b-fe4bbeaab066 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:35:50.655840 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-c4b20f96-1ba8-4fff-898b-fe4bbeaab066 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] [instance: dcb1b50b-9e62-4ff3-9875-3d4635597b45] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:35:50.664797 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-c4b20f96-1ba8-4fff-898b-fe4bbeaab066 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:35:50.668173 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-c4b20f96-1ba8-4fff-898b-fe4bbeaab066 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:35:50.669219 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-c4b20f96-1ba8-4fff-898b-fe4bbeaab066 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:35:50.669829 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-c4b20f96-1ba8-4fff-898b-fe4bbeaab066 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:35:50.691588 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.wsgi [None req-c4b20f96-1ba8-4fff-898b-fe4bbeaab066 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] HTTP exception thrown: Instance dcb1b50b-9e62-4ff3-9875-3d4635597b45 could not be found. Jul 18 10:35:50.699504 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-c4b20f96-1ba8-4fff-898b-fe4bbeaab066 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Request method failure captured: Jul 18 10:35:50.699504 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: request: DELETE /compute/v2.1/servers/dcb1b50b-9e62-4ff3-9875-3d4635597b45 HTTP/1.1 Jul 18 10:35:50.699504 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: Accept: application/json Jul 18 10:35:50.699504 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: Accept-Encoding: identity Jul 18 10:35:50.699504 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: Connection: close Jul 18 10:35:50.699504 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: Content-Length: 0 Jul 18 10:35:50.699504 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: Content-Type: application/json Jul 18 10:35:50.699504 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: Host: 10.222.0.33 Jul 18 10:35:50.699504 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: Openstack-System-Scope: None Jul 18 10:35:50.699504 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: User-Agent: python-urllib3/1.26.9 Jul 18 10:35:50.699504 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Auth-Token: gAAAAABi1TXyRuO93YpXTZGzpMcrXvlaMSRFZzr-AHOj2FRT2T5ihWk1lnTRwNGg9PrJbZQjx8rFUCx5FHM_0tuFNIv3bWjwRyt64fUTE1eFuCeWcTmRM14gEGuSdmP8w3Abds2w_lZwqjtKT13oQUVwIT92owvlu3szREV5s5g3P_QW6cRnhQU Jul 18 10:35:50.699504 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Domain-Id: None Jul 18 10:35:50.699504 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Domain-Name: None Jul 18 10:35:50.699504 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Identity-Status: Confirmed Jul 18 10:35:50.699504 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Is-Admin-Project: True Jul 18 10:35:50.699504 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Project-Domain-Id: default Jul 18 10:35:50.699504 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Project-Domain-Name: Default Jul 18 10:35:50.699504 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Project-Id: e6e487deb7ff45bdbf2cc002d42d12a5 Jul 18 10:35:50.699504 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Project-Name: tempest-AttachVolumeTestJSON-1614237976 Jul 18 10:35:50.699504 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Role: member,reader Jul 18 10:35:50.699504 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Roles: member,reader Jul 18 10:35:50.701263 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e6e487deb7ff45bdbf2cc002d42d12a5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e6e487deb7ff45bdbf2cc002d42d12a5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/e6e487deb7ff45bdbf2cc002d42d12a5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_e6e487deb7ff45bdbf2cc002d42d12a5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jul 18 10:35:50.701263 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Tenant: tempest-AttachVolumeTestJSON-1614237976 Jul 18 10:35:50.701263 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Tenant-Id: e6e487deb7ff45bdbf2cc002d42d12a5 Jul 18 10:35:50.701263 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1614237976 Jul 18 10:35:50.701263 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-User: tempest-AttachVolumeTestJSON-1614237976-project Jul 18 10:35:50.701263 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-User-Domain-Id: default Jul 18 10:35:50.701263 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-User-Domain-Name: Default Jul 18 10:35:50.701263 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-User-Id: 986f90dfbad14324b3fffbd790d60a37 Jul 18 10:35:50.701263 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-User-Name: tempest-AttachVolumeTestJSON-1614237976-project Jul 18 10:35:50.701263 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: method: > Jul 18 10:35:50.701263 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: exception: Instance dcb1b50b-9e62-4ff3-9875-3d4635597b45 could not be found. Jul 18 10:35:50.701263 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: action_args: {'id': 'dcb1b50b-9e62-4ff3-9875-3d4635597b45'} Jul 18 10:35:50.702165 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 10:35:50.702165 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:35:50.702165 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 10:35:50.702165 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 10:35:50.702165 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 10:35:50.702165 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 10:35:50.702165 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 10:35:50.702165 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 10:35:50.702165 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 10:35:50.702165 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 10:35:50.702165 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dcb1b50b-9e62-4ff3-9875-3d4635597b45 could not be found. Jul 18 10:35:50.702165 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi Jul 18 10:35:50.702165 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:35:50.702165 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi Jul 18 10:35:50.702165 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:35:50.702165 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:35:50.702165 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:35:50.702165 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 10:35:50.702165 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 10:35:50.702165 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 10:35:50.703676 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 10:35:50.703676 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 18 10:35:50.703676 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 18 10:35:50.703676 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 18 10:35:50.703676 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 18 10:35:50.703676 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 10:35:50.703676 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 10:35:50.703676 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 10:35:50.703676 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 10:35:50.703676 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dcb1b50b-9e62-4ff3-9875-3d4635597b45 could not be found. Jul 18 10:35:50.703676 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi Jul 18 10:35:50.703676 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:35:50.703676 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi Jul 18 10:35:50.703676 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:35:50.703676 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:35:50.703676 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:35:50.703676 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 10:35:50.703676 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 10:35:50.703676 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dcb1b50b-9e62-4ff3-9875-3d4635597b45 could not be found. Jul 18 10:35:50.703676 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi Jul 18 10:35:50.722311 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-c4b20f96-1ba8-4fff-898b-fe4bbeaab066 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Returning 404 to user: Instance dcb1b50b-9e62-4ff3-9875-3d4635597b45 could not be found. {{(pid=117879) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 10:35:50.730489 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-c4b20f96-1ba8-4fff-898b-fe4bbeaab066 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] 10.222.0.33 "DELETE /compute/v2.1/servers/dcb1b50b-9e62-4ff3-9875-3d4635597b45" status: 404 len: 111 microversion: 2.1 time: 0.076146 Jul 18 10:35:50.731218 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 445/886] 10.222.0.33 () {58 vars in 1238 bytes} [Mon Jul 18 10:35:50 2022] DELETE /compute/v2.1/servers/dcb1b50b-9e62-4ff3-9875-3d4635597b45 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 10:35:50.742403 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-e1d79cf2-8947-4c2b-9de3-12a44bc9b843 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:35:50.743397 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-e1d79cf2-8947-4c2b-9de3-12a44bc9b843 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] [instance: dcb1b50b-9e62-4ff3-9875-3d4635597b45] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:35:50.758543 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-e1d79cf2-8947-4c2b-9de3-12a44bc9b843 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:35:50.759353 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-e1d79cf2-8947-4c2b-9de3-12a44bc9b843 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:35:50.760580 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-e1d79cf2-8947-4c2b-9de3-12a44bc9b843 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:35:50.761335 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-e1d79cf2-8947-4c2b-9de3-12a44bc9b843 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:35:50.805641 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.wsgi [None req-e1d79cf2-8947-4c2b-9de3-12a44bc9b843 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] HTTP exception thrown: Instance dcb1b50b-9e62-4ff3-9875-3d4635597b45 could not be found. Jul 18 10:35:50.807749 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-e1d79cf2-8947-4c2b-9de3-12a44bc9b843 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Request method failure captured: Jul 18 10:35:50.807749 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: request: GET /compute/v2.1/servers/dcb1b50b-9e62-4ff3-9875-3d4635597b45 HTTP/1.1 Jul 18 10:35:50.807749 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: Accept: application/json Jul 18 10:35:50.807749 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: Accept-Encoding: identity Jul 18 10:35:50.807749 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: Connection: close Jul 18 10:35:50.807749 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: Content-Length: 0 Jul 18 10:35:50.807749 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: Content-Type: application/json Jul 18 10:35:50.807749 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: Host: 10.222.0.33 Jul 18 10:35:50.807749 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: Openstack-System-Scope: None Jul 18 10:35:50.807749 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: User-Agent: python-urllib3/1.26.9 Jul 18 10:35:50.807749 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Auth-Token: gAAAAABi1TXyRuO93YpXTZGzpMcrXvlaMSRFZzr-AHOj2FRT2T5ihWk1lnTRwNGg9PrJbZQjx8rFUCx5FHM_0tuFNIv3bWjwRyt64fUTE1eFuCeWcTmRM14gEGuSdmP8w3Abds2w_lZwqjtKT13oQUVwIT92owvlu3szREV5s5g3P_QW6cRnhQU Jul 18 10:35:50.807749 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Domain-Id: None Jul 18 10:35:50.807749 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Domain-Name: None Jul 18 10:35:50.807749 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Identity-Status: Confirmed Jul 18 10:35:50.807749 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Is-Admin-Project: True Jul 18 10:35:50.807749 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Project-Domain-Id: default Jul 18 10:35:50.807749 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Project-Domain-Name: Default Jul 18 10:35:50.807749 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Project-Id: e6e487deb7ff45bdbf2cc002d42d12a5 Jul 18 10:35:50.807749 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Project-Name: tempest-AttachVolumeTestJSON-1614237976 Jul 18 10:35:50.807749 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Role: member,reader Jul 18 10:35:50.807749 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Roles: member,reader Jul 18 10:35:50.809650 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e6e487deb7ff45bdbf2cc002d42d12a5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e6e487deb7ff45bdbf2cc002d42d12a5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/e6e487deb7ff45bdbf2cc002d42d12a5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_e6e487deb7ff45bdbf2cc002d42d12a5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jul 18 10:35:50.809650 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Tenant: tempest-AttachVolumeTestJSON-1614237976 Jul 18 10:35:50.809650 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Tenant-Id: e6e487deb7ff45bdbf2cc002d42d12a5 Jul 18 10:35:50.809650 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1614237976 Jul 18 10:35:50.809650 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-User: tempest-AttachVolumeTestJSON-1614237976-project Jul 18 10:35:50.809650 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-User-Domain-Id: default Jul 18 10:35:50.809650 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-User-Domain-Name: Default Jul 18 10:35:50.809650 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-User-Id: 986f90dfbad14324b3fffbd790d60a37 Jul 18 10:35:50.809650 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-User-Name: tempest-AttachVolumeTestJSON-1614237976-project Jul 18 10:35:50.809650 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: method: > Jul 18 10:35:50.809650 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: exception: Instance dcb1b50b-9e62-4ff3-9875-3d4635597b45 could not be found. Jul 18 10:35:50.809650 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: action_args: {'id': 'dcb1b50b-9e62-4ff3-9875-3d4635597b45'} Jul 18 10:35:50.810625 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 10:35:50.810625 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:35:50.810625 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 10:35:50.810625 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 10:35:50.810625 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 10:35:50.810625 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 10:35:50.810625 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 10:35:50.810625 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 10:35:50.810625 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 10:35:50.810625 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 10:35:50.810625 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dcb1b50b-9e62-4ff3-9875-3d4635597b45 could not be found. Jul 18 10:35:50.810625 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi Jul 18 10:35:50.810625 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:35:50.810625 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi Jul 18 10:35:50.810625 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:35:50.810625 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:35:50.810625 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:35:50.810625 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 10:35:50.810625 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 10:35:50.810625 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 10:35:50.812419 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 10:35:50.812419 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 10:35:50.812419 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 10:35:50.812419 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 10:35:50.812419 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 10:35:50.812419 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 10:35:50.812419 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 10:35:50.812419 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dcb1b50b-9e62-4ff3-9875-3d4635597b45 could not be found. Jul 18 10:35:50.812419 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi Jul 18 10:35:50.812419 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:35:50.812419 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi Jul 18 10:35:50.812419 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:35:50.812419 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:35:50.812419 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:35:50.812419 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 10:35:50.812419 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 10:35:50.812419 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dcb1b50b-9e62-4ff3-9875-3d4635597b45 could not be found. Jul 18 10:35:50.812419 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi Jul 18 10:35:50.815874 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-e1d79cf2-8947-4c2b-9de3-12a44bc9b843 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] Returning 404 to user: Instance dcb1b50b-9e62-4ff3-9875-3d4635597b45 could not be found. {{(pid=117880) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 10:35:50.817162 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-e1d79cf2-8947-4c2b-9de3-12a44bc9b843 tempest-AttachVolumeTestJSON-1614237976 tempest-AttachVolumeTestJSON-1614237976-project] 10.222.0.33 "GET /compute/v2.1/servers/dcb1b50b-9e62-4ff3-9875-3d4635597b45" status: 404 len: 111 microversion: 2.1 time: 0.080722 Jul 18 10:35:50.818401 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 442/887] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:35:50 2022] GET /compute/v2.1/servers/dcb1b50b-9e62-4ff3-9875-3d4635597b45 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 10:35:51.362967 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-e2e72cc3-cd0f-49f6-9280-9ab42dc7b1ce tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:35:51.368832 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-e2e72cc3-cd0f-49f6-9280-9ab42dc7b1ce tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] [instance: b1a84290-3520-427e-af49-f380d2a144bb] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:35:51.380049 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-e2e72cc3-cd0f-49f6-9280-9ab42dc7b1ce tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:35:51.385447 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-e2e72cc3-cd0f-49f6-9280-9ab42dc7b1ce tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:35:51.386514 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-e2e72cc3-cd0f-49f6-9280-9ab42dc7b1ce tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:35:51.387684 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-e2e72cc3-cd0f-49f6-9280-9ab42dc7b1ce tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:35:51.422365 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [req-c199622c-2495-4fe7-b730-1f2472da4c12 req-6fa5f772-24bd-47f5-9ee2-d5b62c2387aa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0851efd6-d3b6-44d7-9b22-e327e1bca393", "tag": "ef589bb7-916e-48f9-bce4-fdf64f4ed1b1"}]} {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:35:51.431913 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [req-c199622c-2495-4fe7-b730-1f2472da4c12 req-6fa5f772-24bd-47f5-9ee2-d5b62c2387aa service nova] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:35:51.432455 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [req-c199622c-2495-4fe7-b730-1f2472da4c12 req-6fa5f772-24bd-47f5-9ee2-d5b62c2387aa service nova] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:35:51.454511 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.compute.server_external_events [req-c199622c-2495-4fe7-b730-1f2472da4c12 req-6fa5f772-24bd-47f5-9ee2-d5b62c2387aa service nova] Creating event network-changed:ef589bb7-916e-48f9-bce4-fdf64f4ed1b1 for instance 0851efd6-d3b6-44d7-9b22-e327e1bca393 on hv-cinder-83754 Jul 18 10:35:51.460562 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [req-c199622c-2495-4fe7-b730-1f2472da4c12 req-6fa5f772-24bd-47f5-9ee2-d5b62c2387aa service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042049 Jul 18 10:35:51.465376 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 443/888] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jul 18 10:35:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 10:35:51.744700 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-e2e72cc3-cd0f-49f6-9280-9ab42dc7b1ce tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:35:51.760081 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-e2e72cc3-cd0f-49f6-9280-9ab42dc7b1ce tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:35:51.762029 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-e2e72cc3-cd0f-49f6-9280-9ab42dc7b1ce tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:35:51.763387 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-e2e72cc3-cd0f-49f6-9280-9ab42dc7b1ce tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] 10.222.0.33 "GET /compute/v2.1/servers/b1a84290-3520-427e-af49-f380d2a144bb" status: 200 len: 1809 microversion: 2.20 time: 0.405043 Jul 18 10:35:51.764135 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 446/889] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jul 18 10:35:51 2022] GET /compute/v2.1/servers/b1a84290-3520-427e-af49-f380d2a144bb => generated 1809 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:35:51.892763 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-9878877c-c814-4cd0-9956-dac5b4b4af7b tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:35:51.893375 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-9878877c-c814-4cd0-9956-dac5b4b4af7b tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] [instance: db62c05e-28a8-4121-a6e5-8abb802f7a17] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:35:51.905681 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-9878877c-c814-4cd0-9956-dac5b4b4af7b tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:35:51.919117 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-9878877c-c814-4cd0-9956-dac5b4b4af7b tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:35:51.920015 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-9878877c-c814-4cd0-9956-dac5b4b4af7b tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:35:51.920538 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-9878877c-c814-4cd0-9956-dac5b4b4af7b tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:35:51.954246 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.wsgi [None req-9878877c-c814-4cd0-9956-dac5b4b4af7b tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] HTTP exception thrown: Instance db62c05e-28a8-4121-a6e5-8abb802f7a17 could not be found. Jul 18 10:35:51.956071 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-9878877c-c814-4cd0-9956-dac5b4b4af7b tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Request method failure captured: Jul 18 10:35:51.956071 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: request: DELETE /compute/v2.1/servers/db62c05e-28a8-4121-a6e5-8abb802f7a17 HTTP/1.1 Jul 18 10:35:51.956071 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: Accept: application/json Jul 18 10:35:51.956071 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: Accept-Encoding: identity Jul 18 10:35:51.956071 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: Connection: close Jul 18 10:35:51.956071 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: Content-Length: 0 Jul 18 10:35:51.956071 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: Content-Type: application/json Jul 18 10:35:51.956071 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: Host: 10.222.0.33 Jul 18 10:35:51.956071 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: Openstack-System-Scope: None Jul 18 10:35:51.956071 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: User-Agent: python-urllib3/1.26.9 Jul 18 10:35:51.956071 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Auth-Token: gAAAAABi1TXs5d9KA6TlIG1Li_VNjhkDxvVxs6ByaKH91Tp5cEYBI8OTiNSNI40UEe5MBLfNqlyuYAjUMpiV_qMg9jtmq9fJwxP3wvSLbrM9kN7Z4diK5bpD5WWlO_9PNIu02mzK2QxOqaTdn-MDBEh-IwIUUSwgtjyQOUrIhUK0fhFwotym42k Jul 18 10:35:51.956071 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Domain-Id: None Jul 18 10:35:51.956071 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Domain-Name: None Jul 18 10:35:51.956071 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Identity-Status: Confirmed Jul 18 10:35:51.956071 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Is-Admin-Project: True Jul 18 10:35:51.956071 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Project-Domain-Id: default Jul 18 10:35:51.956071 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Project-Domain-Name: Default Jul 18 10:35:51.956071 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Project-Id: 1cf3d5bfe9a745f38372c42c9cfa1f63 Jul 18 10:35:51.956071 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Project-Name: tempest-AttachVolumeNegativeTest-653274830 Jul 18 10:35:51.956071 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Role: member,reader Jul 18 10:35:51.956071 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Roles: member,reader Jul 18 10:35:51.957897 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1cf3d5bfe9a745f38372c42c9cfa1f63"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1cf3d5bfe9a745f38372c42c9cfa1f63"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/1cf3d5bfe9a745f38372c42c9cfa1f63"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_1cf3d5bfe9a745f38372c42c9cfa1f63"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jul 18 10:35:51.957897 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Tenant: tempest-AttachVolumeNegativeTest-653274830 Jul 18 10:35:51.957897 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Tenant-Id: 1cf3d5bfe9a745f38372c42c9cfa1f63 Jul 18 10:35:51.957897 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-653274830 Jul 18 10:35:51.957897 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-User: tempest-AttachVolumeNegativeTest-653274830-project Jul 18 10:35:51.957897 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-User-Domain-Id: default Jul 18 10:35:51.957897 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-User-Domain-Name: Default Jul 18 10:35:51.957897 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-User-Id: f25c72896a2d4d619e5ad4b5a0a79aa6 Jul 18 10:35:51.957897 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-User-Name: tempest-AttachVolumeNegativeTest-653274830-project Jul 18 10:35:51.957897 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: method: > Jul 18 10:35:51.957897 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: exception: Instance db62c05e-28a8-4121-a6e5-8abb802f7a17 could not be found. Jul 18 10:35:51.957897 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: action_args: {'id': 'db62c05e-28a8-4121-a6e5-8abb802f7a17'} Jul 18 10:35:51.958926 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 10:35:51.958926 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:35:51.958926 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 10:35:51.958926 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 10:35:51.958926 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 10:35:51.958926 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 10:35:51.958926 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 10:35:51.958926 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 10:35:51.958926 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 10:35:51.958926 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 10:35:51.958926 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance db62c05e-28a8-4121-a6e5-8abb802f7a17 could not be found. Jul 18 10:35:51.958926 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi Jul 18 10:35:51.958926 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:35:51.958926 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi Jul 18 10:35:51.958926 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:35:51.958926 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:35:51.958926 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:35:51.958926 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 10:35:51.958926 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 10:35:51.958926 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 10:35:51.960597 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 10:35:51.960597 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 18 10:35:51.960597 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 18 10:35:51.960597 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 18 10:35:51.960597 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 18 10:35:51.960597 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 10:35:51.960597 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 10:35:51.960597 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 10:35:51.960597 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 10:35:51.960597 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance db62c05e-28a8-4121-a6e5-8abb802f7a17 could not be found. Jul 18 10:35:51.960597 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi Jul 18 10:35:51.960597 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:35:51.960597 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi Jul 18 10:35:51.960597 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:35:51.960597 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:35:51.960597 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:35:51.960597 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 10:35:51.960597 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 10:35:51.960597 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance db62c05e-28a8-4121-a6e5-8abb802f7a17 could not be found. Jul 18 10:35:51.960597 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi Jul 18 10:35:51.966691 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-9878877c-c814-4cd0-9956-dac5b4b4af7b tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Returning 404 to user: Instance db62c05e-28a8-4121-a6e5-8abb802f7a17 could not be found. {{(pid=117880) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 10:35:51.972739 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-9878877c-c814-4cd0-9956-dac5b4b4af7b tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] 10.222.0.33 "DELETE /compute/v2.1/servers/db62c05e-28a8-4121-a6e5-8abb802f7a17" status: 404 len: 111 microversion: 2.1 time: 0.084298 Jul 18 10:35:51.973576 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 444/890] 10.222.0.33 () {58 vars in 1238 bytes} [Mon Jul 18 10:35:51 2022] DELETE /compute/v2.1/servers/db62c05e-28a8-4121-a6e5-8abb802f7a17 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 10:35:51.984079 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-907f5b3e-05fa-4dd4-bc1d-7599aea95283 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:35:51.984743 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-907f5b3e-05fa-4dd4-bc1d-7599aea95283 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] [instance: db62c05e-28a8-4121-a6e5-8abb802f7a17] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:35:51.998694 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-907f5b3e-05fa-4dd4-bc1d-7599aea95283 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:35:52.000346 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-907f5b3e-05fa-4dd4-bc1d-7599aea95283 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:35:52.001269 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-907f5b3e-05fa-4dd4-bc1d-7599aea95283 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:35:52.005882 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-907f5b3e-05fa-4dd4-bc1d-7599aea95283 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:35:52.050747 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.wsgi [None req-907f5b3e-05fa-4dd4-bc1d-7599aea95283 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] HTTP exception thrown: Instance db62c05e-28a8-4121-a6e5-8abb802f7a17 could not be found. Jul 18 10:35:52.058108 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-907f5b3e-05fa-4dd4-bc1d-7599aea95283 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Request method failure captured: Jul 18 10:35:52.058108 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: request: GET /compute/v2.1/servers/db62c05e-28a8-4121-a6e5-8abb802f7a17 HTTP/1.1 Jul 18 10:35:52.058108 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: Accept: application/json Jul 18 10:35:52.058108 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: Accept-Encoding: identity Jul 18 10:35:52.058108 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: Connection: close Jul 18 10:35:52.058108 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: Content-Length: 0 Jul 18 10:35:52.058108 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: Content-Type: application/json Jul 18 10:35:52.058108 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: Host: 10.222.0.33 Jul 18 10:35:52.058108 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: Openstack-System-Scope: None Jul 18 10:35:52.058108 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: User-Agent: python-urllib3/1.26.9 Jul 18 10:35:52.058108 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Auth-Token: gAAAAABi1TXs5d9KA6TlIG1Li_VNjhkDxvVxs6ByaKH91Tp5cEYBI8OTiNSNI40UEe5MBLfNqlyuYAjUMpiV_qMg9jtmq9fJwxP3wvSLbrM9kN7Z4diK5bpD5WWlO_9PNIu02mzK2QxOqaTdn-MDBEh-IwIUUSwgtjyQOUrIhUK0fhFwotym42k Jul 18 10:35:52.058108 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Domain-Id: None Jul 18 10:35:52.058108 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Domain-Name: None Jul 18 10:35:52.058108 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Identity-Status: Confirmed Jul 18 10:35:52.058108 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Is-Admin-Project: True Jul 18 10:35:52.058108 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Project-Domain-Id: default Jul 18 10:35:52.058108 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Project-Domain-Name: Default Jul 18 10:35:52.058108 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Project-Id: 1cf3d5bfe9a745f38372c42c9cfa1f63 Jul 18 10:35:52.058108 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Project-Name: tempest-AttachVolumeNegativeTest-653274830 Jul 18 10:35:52.058108 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Role: member,reader Jul 18 10:35:52.058108 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Roles: member,reader Jul 18 10:35:52.059896 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1cf3d5bfe9a745f38372c42c9cfa1f63"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1cf3d5bfe9a745f38372c42c9cfa1f63"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/1cf3d5bfe9a745f38372c42c9cfa1f63"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_1cf3d5bfe9a745f38372c42c9cfa1f63"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jul 18 10:35:52.059896 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Tenant: tempest-AttachVolumeNegativeTest-653274830 Jul 18 10:35:52.059896 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Tenant-Id: 1cf3d5bfe9a745f38372c42c9cfa1f63 Jul 18 10:35:52.059896 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-653274830 Jul 18 10:35:52.059896 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-User: tempest-AttachVolumeNegativeTest-653274830-project Jul 18 10:35:52.059896 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-User-Domain-Id: default Jul 18 10:35:52.059896 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-User-Domain-Name: Default Jul 18 10:35:52.059896 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-User-Id: f25c72896a2d4d619e5ad4b5a0a79aa6 Jul 18 10:35:52.059896 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-User-Name: tempest-AttachVolumeNegativeTest-653274830-project Jul 18 10:35:52.059896 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: method: > Jul 18 10:35:52.059896 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: exception: Instance db62c05e-28a8-4121-a6e5-8abb802f7a17 could not be found. Jul 18 10:35:52.059896 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: action_args: {'id': 'db62c05e-28a8-4121-a6e5-8abb802f7a17'} Jul 18 10:35:52.060871 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 10:35:52.060871 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:35:52.060871 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 10:35:52.060871 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 10:35:52.060871 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 10:35:52.060871 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 10:35:52.060871 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 10:35:52.060871 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 10:35:52.060871 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 10:35:52.060871 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 10:35:52.060871 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance db62c05e-28a8-4121-a6e5-8abb802f7a17 could not be found. Jul 18 10:35:52.060871 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi Jul 18 10:35:52.060871 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:35:52.060871 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi Jul 18 10:35:52.060871 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:35:52.060871 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:35:52.060871 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:35:52.060871 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 10:35:52.060871 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 10:35:52.060871 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 10:35:52.062344 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 10:35:52.062344 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 10:35:52.062344 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 10:35:52.062344 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 10:35:52.062344 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 10:35:52.062344 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 10:35:52.062344 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 10:35:52.062344 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance db62c05e-28a8-4121-a6e5-8abb802f7a17 could not be found. Jul 18 10:35:52.062344 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi Jul 18 10:35:52.062344 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:35:52.062344 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi Jul 18 10:35:52.062344 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:35:52.062344 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:35:52.062344 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:35:52.062344 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 10:35:52.062344 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 10:35:52.062344 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance db62c05e-28a8-4121-a6e5-8abb802f7a17 could not be found. Jul 18 10:35:52.062344 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi Jul 18 10:35:52.068230 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-907f5b3e-05fa-4dd4-bc1d-7599aea95283 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] Returning 404 to user: Instance db62c05e-28a8-4121-a6e5-8abb802f7a17 could not be found. {{(pid=117879) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 10:35:52.068230 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-907f5b3e-05fa-4dd4-bc1d-7599aea95283 tempest-AttachVolumeNegativeTest-653274830 tempest-AttachVolumeNegativeTest-653274830-project] 10.222.0.33 "GET /compute/v2.1/servers/db62c05e-28a8-4121-a6e5-8abb802f7a17" status: 404 len: 111 microversion: 2.1 time: 0.082366 Jul 18 10:35:52.068230 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 447/891] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:35:51 2022] GET /compute/v2.1/servers/db62c05e-28a8-4121-a6e5-8abb802f7a17 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 10:35:52.783097 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-d2b9f8cf-677a-4efe-8d4b-284832d9c5a7 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:35:52.784996 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-d2b9f8cf-677a-4efe-8d4b-284832d9c5a7 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] [instance: b1a84290-3520-427e-af49-f380d2a144bb] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:35:52.787707 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG dbcounter [-] [117880] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=117880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:35:52.801726 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-d2b9f8cf-677a-4efe-8d4b-284832d9c5a7 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:35:52.802495 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-d2b9f8cf-677a-4efe-8d4b-284832d9c5a7 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:35:52.803569 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-d2b9f8cf-677a-4efe-8d4b-284832d9c5a7 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:35:52.806931 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-d2b9f8cf-677a-4efe-8d4b-284832d9c5a7 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:35:53.511360 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-d2b9f8cf-677a-4efe-8d4b-284832d9c5a7 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:35:53.522393 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-d2b9f8cf-677a-4efe-8d4b-284832d9c5a7 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:35:53.530539 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-d2b9f8cf-677a-4efe-8d4b-284832d9c5a7 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:35:53.532134 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-d2b9f8cf-677a-4efe-8d4b-284832d9c5a7 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] 10.222.0.33 "GET /compute/v2.1/servers/b1a84290-3520-427e-af49-f380d2a144bb" status: 200 len: 1809 microversion: 2.20 time: 0.752849 Jul 18 10:35:53.545603 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 445/892] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jul 18 10:35:52 2022] GET /compute/v2.1/servers/b1a84290-3520-427e-af49-f380d2a144bb => generated 1809 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:35:54.566971 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-59be894e-80ae-46b3-af99-73eca4e13f0a tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:35:54.569954 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-59be894e-80ae-46b3-af99-73eca4e13f0a tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] [instance: b1a84290-3520-427e-af49-f380d2a144bb] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:35:54.578610 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-59be894e-80ae-46b3-af99-73eca4e13f0a tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:35:54.579408 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-59be894e-80ae-46b3-af99-73eca4e13f0a tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:35:54.580466 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-59be894e-80ae-46b3-af99-73eca4e13f0a tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:35:54.580997 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-59be894e-80ae-46b3-af99-73eca4e13f0a tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:35:54.869996 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-59be894e-80ae-46b3-af99-73eca4e13f0a tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:35:54.885605 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-59be894e-80ae-46b3-af99-73eca4e13f0a tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:35:54.891445 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-59be894e-80ae-46b3-af99-73eca4e13f0a tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:35:54.895257 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-59be894e-80ae-46b3-af99-73eca4e13f0a tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] 10.222.0.33 "GET /compute/v2.1/servers/b1a84290-3520-427e-af49-f380d2a144bb" status: 200 len: 1809 microversion: 2.20 time: 0.334543 Jul 18 10:35:54.897582 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 448/893] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jul 18 10:35:54 2022] GET /compute/v2.1/servers/b1a84290-3520-427e-af49-f380d2a144bb => generated 1809 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:35:55.919901 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-e5f03673-f561-4e04-819a-990dac96a62a tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:35:55.922188 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-e5f03673-f561-4e04-819a-990dac96a62a tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] [instance: b1a84290-3520-427e-af49-f380d2a144bb] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:35:55.937706 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-e5f03673-f561-4e04-819a-990dac96a62a tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:35:55.938922 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-e5f03673-f561-4e04-819a-990dac96a62a tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:35:55.943023 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-e5f03673-f561-4e04-819a-990dac96a62a tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:35:55.945320 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-e5f03673-f561-4e04-819a-990dac96a62a tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:35:56.398406 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-e5f03673-f561-4e04-819a-990dac96a62a tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:35:56.418007 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-e5f03673-f561-4e04-819a-990dac96a62a tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:35:56.423207 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-e5f03673-f561-4e04-819a-990dac96a62a tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:35:56.427730 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-e5f03673-f561-4e04-819a-990dac96a62a tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] 10.222.0.33 "GET /compute/v2.1/servers/b1a84290-3520-427e-af49-f380d2a144bb" status: 200 len: 1809 microversion: 2.20 time: 0.513423 Jul 18 10:35:56.429441 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 446/894] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jul 18 10:35:55 2022] GET /compute/v2.1/servers/b1a84290-3520-427e-af49-f380d2a144bb => generated 1809 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:35:57.450135 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-4c3ae36b-df61-4d42-b980-d659f4331a57 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:35:57.450904 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-4c3ae36b-df61-4d42-b980-d659f4331a57 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] [instance: b1a84290-3520-427e-af49-f380d2a144bb] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:35:57.463835 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-4c3ae36b-df61-4d42-b980-d659f4331a57 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:35:57.469731 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-4c3ae36b-df61-4d42-b980-d659f4331a57 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:35:57.470835 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-4c3ae36b-df61-4d42-b980-d659f4331a57 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:35:57.480393 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-4c3ae36b-df61-4d42-b980-d659f4331a57 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:35:58.325629 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-4c3ae36b-df61-4d42-b980-d659f4331a57 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:35:58.343310 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-4c3ae36b-df61-4d42-b980-d659f4331a57 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:35:58.351086 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-4c3ae36b-df61-4d42-b980-d659f4331a57 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:35:58.354807 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-4c3ae36b-df61-4d42-b980-d659f4331a57 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] 10.222.0.33 "GET /compute/v2.1/servers/b1a84290-3520-427e-af49-f380d2a144bb" status: 200 len: 1809 microversion: 2.20 time: 0.911290 Jul 18 10:35:58.358291 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 449/895] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jul 18 10:35:57 2022] GET /compute/v2.1/servers/b1a84290-3520-427e-af49-f380d2a144bb => generated 1809 bytes in 914 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 10:35:59.373922 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-fe14fb09-a709-433c-aaea-04353246f2f8 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:35:59.374769 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-fe14fb09-a709-433c-aaea-04353246f2f8 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] [instance: b1a84290-3520-427e-af49-f380d2a144bb] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:35:59.383116 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-fe14fb09-a709-433c-aaea-04353246f2f8 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:35:59.383919 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-fe14fb09-a709-433c-aaea-04353246f2f8 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:35:59.390843 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-fe14fb09-a709-433c-aaea-04353246f2f8 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:35:59.391432 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-fe14fb09-a709-433c-aaea-04353246f2f8 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:35:59.538732 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-fe14fb09-a709-433c-aaea-04353246f2f8 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:35:59.547044 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-fe14fb09-a709-433c-aaea-04353246f2f8 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:35:59.548549 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-fe14fb09-a709-433c-aaea-04353246f2f8 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:35:59.549705 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-fe14fb09-a709-433c-aaea-04353246f2f8 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] 10.222.0.33 "GET /compute/v2.1/servers/b1a84290-3520-427e-af49-f380d2a144bb" status: 200 len: 1809 microversion: 2.20 time: 0.179702 Jul 18 10:35:59.550255 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 447/896] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jul 18 10:35:59 2022] GET /compute/v2.1/servers/b1a84290-3520-427e-af49-f380d2a144bb => generated 1809 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:36:00.567246 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-3d43645c-64c6-4458-9b0c-1c7a24f69b58 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:36:00.567956 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-3d43645c-64c6-4458-9b0c-1c7a24f69b58 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] [instance: b1a84290-3520-427e-af49-f380d2a144bb] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:36:00.574398 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-3d43645c-64c6-4458-9b0c-1c7a24f69b58 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:36:00.574846 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-3d43645c-64c6-4458-9b0c-1c7a24f69b58 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:36:00.575615 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-3d43645c-64c6-4458-9b0c-1c7a24f69b58 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:36:00.576064 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-3d43645c-64c6-4458-9b0c-1c7a24f69b58 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:36:00.714690 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-3d43645c-64c6-4458-9b0c-1c7a24f69b58 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:36:00.723627 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-3d43645c-64c6-4458-9b0c-1c7a24f69b58 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:36:00.725165 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-3d43645c-64c6-4458-9b0c-1c7a24f69b58 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:36:00.726351 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-3d43645c-64c6-4458-9b0c-1c7a24f69b58 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] 10.222.0.33 "GET /compute/v2.1/servers/b1a84290-3520-427e-af49-f380d2a144bb" status: 200 len: 1809 microversion: 2.20 time: 0.163078 Jul 18 10:36:00.727179 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 450/897] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jul 18 10:36:00 2022] GET /compute/v2.1/servers/b1a84290-3520-427e-af49-f380d2a144bb => generated 1809 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:36:01.501472 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-58888964-8061-46f7-8668-fe2a41401c61 tempest-VolumesTestJSON-1035848504 tempest-VolumesTestJSON-1035848504-project] Calling method '.version_select at 0x7f9f49eaa430>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:36:01.549788 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-58888964-8061-46f7-8668-fe2a41401c61 tempest-VolumesTestJSON-1035848504 tempest-VolumesTestJSON-1035848504-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/f6c553be-4c54-4b43-95ce-2fbada79a417" status: 200 len: 349 microversion: 2.1 time: 0.052017 Jul 18 10:36:01.550345 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 448/898] 10.222.0.33 () {58 vars in 1244 bytes} [Mon Jul 18 10:36:01 2022] GET /compute/v2.1/os-volumes/f6c553be-4c54-4b43-95ce-2fbada79a417 => generated 349 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:36:01.757086 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-d364bcff-19fc-4a59-90ba-5236f5198e30 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:36:01.757902 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-d364bcff-19fc-4a59-90ba-5236f5198e30 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] [instance: b1a84290-3520-427e-af49-f380d2a144bb] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:36:01.766485 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-d364bcff-19fc-4a59-90ba-5236f5198e30 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:36:01.766485 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-d364bcff-19fc-4a59-90ba-5236f5198e30 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:36:01.766958 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-d364bcff-19fc-4a59-90ba-5236f5198e30 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:36:01.767431 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-d364bcff-19fc-4a59-90ba-5236f5198e30 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:36:01.932038 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-d364bcff-19fc-4a59-90ba-5236f5198e30 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:36:01.943238 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-d364bcff-19fc-4a59-90ba-5236f5198e30 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:36:01.945419 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-d364bcff-19fc-4a59-90ba-5236f5198e30 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:36:01.946750 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-d364bcff-19fc-4a59-90ba-5236f5198e30 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] 10.222.0.33 "GET /compute/v2.1/servers/b1a84290-3520-427e-af49-f380d2a144bb" status: 200 len: 1809 microversion: 2.20 time: 0.196612 Jul 18 10:36:01.950007 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 451/899] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jul 18 10:36:01 2022] GET /compute/v2.1/servers/b1a84290-3520-427e-af49-f380d2a144bb => generated 1809 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:36:02.958405 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-bf1eba15-ba05-41e8-9597-3d5eaf3379fa tempest-VolumesTestJSON-1035848504 tempest-VolumesTestJSON-1035848504-project] Calling method '.version_select at 0x7f9f49e96280>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:36:02.965446 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-43eeb30b-615e-4d42-8b2f-ea62cf04aa5c tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:36:02.966281 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-43eeb30b-615e-4d42-8b2f-ea62cf04aa5c tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] [instance: b1a84290-3520-427e-af49-f380d2a144bb] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:36:02.971417 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG dbcounter [-] [117879] Writing DB stats nova_api:SELECT=88,nova_api:DELETE=1 {{(pid=117879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:36:02.973532 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-43eeb30b-615e-4d42-8b2f-ea62cf04aa5c tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:36:02.974010 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-43eeb30b-615e-4d42-8b2f-ea62cf04aa5c tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:36:02.974770 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-43eeb30b-615e-4d42-8b2f-ea62cf04aa5c tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:36:02.975200 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-43eeb30b-615e-4d42-8b2f-ea62cf04aa5c tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:36:03.005658 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-bf1eba15-ba05-41e8-9597-3d5eaf3379fa tempest-VolumesTestJSON-1035848504 tempest-VolumesTestJSON-1035848504-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/95c14052-cc3e-4b5e-aa83-5dc3afe4a2c9" status: 200 len: 351 microversion: 2.1 time: 0.052009 Jul 18 10:36:03.006212 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 449/900] 10.222.0.33 () {58 vars in 1244 bytes} [Mon Jul 18 10:36:02 2022] GET /compute/v2.1/os-volumes/95c14052-cc3e-4b5e-aa83-5dc3afe4a2c9 => generated 351 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 10:36:03.108047 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-43eeb30b-615e-4d42-8b2f-ea62cf04aa5c tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:36:03.117031 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-43eeb30b-615e-4d42-8b2f-ea62cf04aa5c tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:36:03.118512 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-43eeb30b-615e-4d42-8b2f-ea62cf04aa5c tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:36:03.119659 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-43eeb30b-615e-4d42-8b2f-ea62cf04aa5c tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] 10.222.0.33 "GET /compute/v2.1/servers/b1a84290-3520-427e-af49-f380d2a144bb" status: 200 len: 1809 microversion: 2.20 time: 0.158382 Jul 18 10:36:03.120208 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 452/901] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jul 18 10:36:02 2022] GET /compute/v2.1/servers/b1a84290-3520-427e-af49-f380d2a144bb => generated 1809 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 10:36:04.138116 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-a6b27935-c3c5-4d20-8590-7e92a2aca897 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:36:04.138718 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-a6b27935-c3c5-4d20-8590-7e92a2aca897 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] [instance: b1a84290-3520-427e-af49-f380d2a144bb] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:36:04.145413 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-a6b27935-c3c5-4d20-8590-7e92a2aca897 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:36:04.145860 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-a6b27935-c3c5-4d20-8590-7e92a2aca897 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:36:04.146620 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-a6b27935-c3c5-4d20-8590-7e92a2aca897 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:36:04.147051 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-a6b27935-c3c5-4d20-8590-7e92a2aca897 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:36:04.277691 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-a6b27935-c3c5-4d20-8590-7e92a2aca897 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:36:04.286542 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-a6b27935-c3c5-4d20-8590-7e92a2aca897 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:36:04.288031 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-a6b27935-c3c5-4d20-8590-7e92a2aca897 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:36:04.289205 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-a6b27935-c3c5-4d20-8590-7e92a2aca897 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] 10.222.0.33 "GET /compute/v2.1/servers/b1a84290-3520-427e-af49-f380d2a144bb" status: 200 len: 1809 microversion: 2.20 time: 0.155477 Jul 18 10:36:04.289751 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 450/902] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jul 18 10:36:04 2022] GET /compute/v2.1/servers/b1a84290-3520-427e-af49-f380d2a144bb => generated 1809 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:36:04.342959 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-2352a167-df7b-4ceb-bd04-ec86115076eb tempest-VolumesTestJSON-1035848504 tempest-VolumesTestJSON-1035848504-project] Calling method '.version_select at 0x7f9f4a0124c0>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:36:04.389894 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-2352a167-df7b-4ceb-bd04-ec86115076eb tempest-VolumesTestJSON-1035848504 tempest-VolumesTestJSON-1035848504-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/b7b0cd7c-2145-48bc-a4d1-62fbf1901b61" status: 200 len: 351 microversion: 2.1 time: 0.050529 Jul 18 10:36:04.390392 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 453/903] 10.222.0.33 () {58 vars in 1244 bytes} [Mon Jul 18 10:36:04 2022] GET /compute/v2.1/os-volumes/b7b0cd7c-2145-48bc-a4d1-62fbf1901b61 => generated 351 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:36:04.401308 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-6a0e4c6a-3dc3-4a4c-a23c-f2331e5f47b8 tempest-VolumesTestJSON-1035848504 tempest-VolumesTestJSON-1035848504-project] Calling method '.version_select at 0x7f9f49f23e50>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:36:04.482465 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-6a0e4c6a-3dc3-4a4c-a23c-f2331e5f47b8 tempest-VolumesTestJSON-1035848504 tempest-VolumesTestJSON-1035848504-project] 10.222.0.33 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.084810 Jul 18 10:36:04.483034 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 451/904] 10.222.0.33 () {58 vars in 1133 bytes} [Mon Jul 18 10:36:04 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:36:04.495308 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-823d473b-ccc6-4959-9fce-3f2ebd862285 tempest-VolumesTestJSON-1035848504 tempest-VolumesTestJSON-1035848504-project] Calling method '.version_select at 0x7f9f49fd31f0>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:36:04.574214 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-823d473b-ccc6-4959-9fce-3f2ebd862285 tempest-VolumesTestJSON-1035848504 tempest-VolumesTestJSON-1035848504-project] 10.222.0.33 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.082584 Jul 18 10:36:04.574775 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 454/905] 10.222.0.33 () {58 vars in 1148 bytes} [Mon Jul 18 10:36:04 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:36:04.586291 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-8b46a98e-c44e-443c-b003-19536db169a6 tempest-VolumesTestJSON-1035848504 tempest-VolumesTestJSON-1035848504-project] Calling method '.version_select at 0x7f9f49fa64c0>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:36:04.665071 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-8b46a98e-c44e-443c-b003-19536db169a6 tempest-VolumesTestJSON-1035848504 tempest-VolumesTestJSON-1035848504-project] 10.222.0.33 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.082530 Jul 18 10:36:04.665631 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 452/906] 10.222.0.33 () {58 vars in 1133 bytes} [Mon Jul 18 10:36:04 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:36:04.677116 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-72f95e66-105a-4478-8bbd-af6f74174952 tempest-VolumesTestJSON-1035848504 tempest-VolumesTestJSON-1035848504-project] Calling method '.version_select at 0x7f9f49f6e940>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:36:04.757157 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-72f95e66-105a-4478-8bbd-af6f74174952 tempest-VolumesTestJSON-1035848504 tempest-VolumesTestJSON-1035848504-project] 10.222.0.33 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.084213 Jul 18 10:36:04.757735 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 455/907] 10.222.0.33 () {58 vars in 1166 bytes} [Mon Jul 18 10:36:04 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:36:04.769105 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-047ccea7-9c10-49e5-a0fa-7e2fc59e8d8c tempest-VolumesTestJSON-1035848504 tempest-VolumesTestJSON-1035848504-project] Calling method '.version_select at 0x7f9f49e96280>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:36:04.851326 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-047ccea7-9c10-49e5-a0fa-7e2fc59e8d8c tempest-VolumesTestJSON-1035848504 tempest-VolumesTestJSON-1035848504-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.085856 Jul 18 10:36:04.852161 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 453/908] 10.222.0.33 () {58 vars in 1169 bytes} [Mon Jul 18 10:36:04 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:36:04.864463 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-6f32ec00-b0ad-433a-975a-41c31117d309 tempest-VolumesTestJSON-1035848504 tempest-VolumesTestJSON-1035848504-project] Calling method '.version_select at 0x7f9f4a012310>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:36:04.946323 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-6f32ec00-b0ad-433a-975a-41c31117d309 tempest-VolumesTestJSON-1035848504 tempest-VolumesTestJSON-1035848504-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.086185 Jul 18 10:36:04.946896 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 456/909] 10.222.0.33 () {58 vars in 1154 bytes} [Mon Jul 18 10:36:04 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:36:04.957916 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-4561f33f-d30c-4fcd-a6c8-fbe9862ef1c9 tempest-VolumesTestJSON-1035848504 tempest-VolumesTestJSON-1035848504-project] Calling method '.version_select at 0x7f9f4a3db040>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:36:05.036959 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-4561f33f-d30c-4fcd-a6c8-fbe9862ef1c9 tempest-VolumesTestJSON-1035848504 tempest-VolumesTestJSON-1035848504-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.082717 Jul 18 10:36:05.037553 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 454/910] 10.222.0.33 () {58 vars in 1187 bytes} [Mon Jul 18 10:36:04 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:36:05.049279 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-52b20998-b4d5-486e-9b50-df7f8a1eec15 tempest-VolumesTestJSON-1035848504 tempest-VolumesTestJSON-1035848504-project] Calling method '.version_select at 0x7f9f49f80820>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:36:05.128221 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-52b20998-b4d5-486e-9b50-df7f8a1eec15 tempest-VolumesTestJSON-1035848504 tempest-VolumesTestJSON-1035848504-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.083123 Jul 18 10:36:05.128817 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 457/911] 10.222.0.33 () {58 vars in 1154 bytes} [Mon Jul 18 10:36:05 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:36:05.307651 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-e4e745c7-c026-4ff5-962e-aa88844b0636 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:36:05.308268 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-e4e745c7-c026-4ff5-962e-aa88844b0636 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] [instance: b1a84290-3520-427e-af49-f380d2a144bb] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:36:05.314809 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-e4e745c7-c026-4ff5-962e-aa88844b0636 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:36:05.315262 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-e4e745c7-c026-4ff5-962e-aa88844b0636 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:36:05.316030 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-e4e745c7-c026-4ff5-962e-aa88844b0636 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:36:05.316472 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-e4e745c7-c026-4ff5-962e-aa88844b0636 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:36:05.443475 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-e4e745c7-c026-4ff5-962e-aa88844b0636 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:36:05.451881 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-e4e745c7-c026-4ff5-962e-aa88844b0636 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:36:05.453409 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-e4e745c7-c026-4ff5-962e-aa88844b0636 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:36:05.454571 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-e4e745c7-c026-4ff5-962e-aa88844b0636 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] 10.222.0.33 "GET /compute/v2.1/servers/b1a84290-3520-427e-af49-f380d2a144bb" status: 200 len: 1809 microversion: 2.20 time: 0.151367 Jul 18 10:36:05.455665 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 455/912] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jul 18 10:36:05 2022] GET /compute/v2.1/servers/b1a84290-3520-427e-af49-f380d2a144bb => generated 1809 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:36:06.473920 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-fe9f4197-5e38-4e6b-85bb-ab2b72207ee4 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:36:06.474622 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-fe9f4197-5e38-4e6b-85bb-ab2b72207ee4 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] [instance: b1a84290-3520-427e-af49-f380d2a144bb] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:36:06.481678 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-fe9f4197-5e38-4e6b-85bb-ab2b72207ee4 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:36:06.482132 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-fe9f4197-5e38-4e6b-85bb-ab2b72207ee4 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:36:06.482899 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-fe9f4197-5e38-4e6b-85bb-ab2b72207ee4 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:36:06.483331 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-fe9f4197-5e38-4e6b-85bb-ab2b72207ee4 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:36:06.635057 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-fe9f4197-5e38-4e6b-85bb-ab2b72207ee4 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:36:06.644236 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-fe9f4197-5e38-4e6b-85bb-ab2b72207ee4 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:36:06.645872 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-fe9f4197-5e38-4e6b-85bb-ab2b72207ee4 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:36:06.647160 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-fe9f4197-5e38-4e6b-85bb-ab2b72207ee4 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] 10.222.0.33 "GET /compute/v2.1/servers/b1a84290-3520-427e-af49-f380d2a144bb" status: 200 len: 1809 microversion: 2.20 time: 0.178063 Jul 18 10:36:06.647705 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 458/913] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jul 18 10:36:06 2022] GET /compute/v2.1/servers/b1a84290-3520-427e-af49-f380d2a144bb => generated 1809 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:36:07.667938 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-c0157746-e2e0-4d65-95a0-f75f39103d0c tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:36:07.668691 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-c0157746-e2e0-4d65-95a0-f75f39103d0c tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] [instance: b1a84290-3520-427e-af49-f380d2a144bb] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:36:07.675535 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-c0157746-e2e0-4d65-95a0-f75f39103d0c tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:36:07.675984 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-c0157746-e2e0-4d65-95a0-f75f39103d0c tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:36:07.676877 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-c0157746-e2e0-4d65-95a0-f75f39103d0c tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:36:07.677524 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-c0157746-e2e0-4d65-95a0-f75f39103d0c tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:36:07.810169 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-c0157746-e2e0-4d65-95a0-f75f39103d0c tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:36:07.819494 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-c0157746-e2e0-4d65-95a0-f75f39103d0c tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:36:07.821088 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-c0157746-e2e0-4d65-95a0-f75f39103d0c tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:36:07.822343 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-c0157746-e2e0-4d65-95a0-f75f39103d0c tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] 10.222.0.33 "GET /compute/v2.1/servers/b1a84290-3520-427e-af49-f380d2a144bb" status: 200 len: 1809 microversion: 2.20 time: 0.159254 Jul 18 10:36:07.822890 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 456/914] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jul 18 10:36:07 2022] GET /compute/v2.1/servers/b1a84290-3520-427e-af49-f380d2a144bb => generated 1809 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:36:08.840635 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-1c462054-d4da-46c8-a9b9-7483c54ec790 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:36:08.841237 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-1c462054-d4da-46c8-a9b9-7483c54ec790 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] [instance: b1a84290-3520-427e-af49-f380d2a144bb] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:36:08.847699 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-1c462054-d4da-46c8-a9b9-7483c54ec790 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:36:08.848139 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-1c462054-d4da-46c8-a9b9-7483c54ec790 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:36:08.848929 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-1c462054-d4da-46c8-a9b9-7483c54ec790 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:36:08.849360 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-1c462054-d4da-46c8-a9b9-7483c54ec790 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:36:08.866664 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG dbcounter [-] [117879] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=117879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:36:08.977795 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-1c462054-d4da-46c8-a9b9-7483c54ec790 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:36:08.986564 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-1c462054-d4da-46c8-a9b9-7483c54ec790 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:36:08.988053 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-1c462054-d4da-46c8-a9b9-7483c54ec790 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:36:08.989218 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-1c462054-d4da-46c8-a9b9-7483c54ec790 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] 10.222.0.33 "GET /compute/v2.1/servers/b1a84290-3520-427e-af49-f380d2a144bb" status: 200 len: 1809 microversion: 2.20 time: 0.152519 Jul 18 10:36:08.989787 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 459/915] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jul 18 10:36:08 2022] GET /compute/v2.1/servers/b1a84290-3520-427e-af49-f380d2a144bb => generated 1809 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:36:10.007528 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-725cd4c3-f28f-4163-bf64-5a5864089b36 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:36:10.008465 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-725cd4c3-f28f-4163-bf64-5a5864089b36 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] [instance: b1a84290-3520-427e-af49-f380d2a144bb] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:36:10.015516 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-725cd4c3-f28f-4163-bf64-5a5864089b36 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:36:10.016085 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-725cd4c3-f28f-4163-bf64-5a5864089b36 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:36:10.017604 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-725cd4c3-f28f-4163-bf64-5a5864089b36 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:36:10.018370 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-725cd4c3-f28f-4163-bf64-5a5864089b36 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:36:10.201039 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-725cd4c3-f28f-4163-bf64-5a5864089b36 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:36:10.210382 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-725cd4c3-f28f-4163-bf64-5a5864089b36 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:36:10.212141 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-725cd4c3-f28f-4163-bf64-5a5864089b36 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:36:10.214180 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-725cd4c3-f28f-4163-bf64-5a5864089b36 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] 10.222.0.33 "GET /compute/v2.1/servers/b1a84290-3520-427e-af49-f380d2a144bb" status: 200 len: 1809 microversion: 2.20 time: 0.210732 Jul 18 10:36:10.215516 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 457/916] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jul 18 10:36:10 2022] GET /compute/v2.1/servers/b1a84290-3520-427e-af49-f380d2a144bb => generated 1809 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:36:11.232818 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-3e1c722d-1792-43ab-9b88-f88492111548 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:36:11.233421 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-3e1c722d-1792-43ab-9b88-f88492111548 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] [instance: b1a84290-3520-427e-af49-f380d2a144bb] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:36:11.240581 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-3e1c722d-1792-43ab-9b88-f88492111548 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:36:11.241042 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-3e1c722d-1792-43ab-9b88-f88492111548 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:36:11.241812 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-3e1c722d-1792-43ab-9b88-f88492111548 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:36:11.242253 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-3e1c722d-1792-43ab-9b88-f88492111548 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:36:11.394877 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-3e1c722d-1792-43ab-9b88-f88492111548 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:36:11.403147 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-3e1c722d-1792-43ab-9b88-f88492111548 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:36:11.404665 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-3e1c722d-1792-43ab-9b88-f88492111548 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:36:11.405818 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-3e1c722d-1792-43ab-9b88-f88492111548 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] 10.222.0.33 "GET /compute/v2.1/servers/b1a84290-3520-427e-af49-f380d2a144bb" status: 200 len: 1809 microversion: 2.20 time: 0.176996 Jul 18 10:36:11.406372 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 460/917] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jul 18 10:36:11 2022] GET /compute/v2.1/servers/b1a84290-3520-427e-af49-f380d2a144bb => generated 1809 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:36:12.038609 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [req-f0bc5923-6fb3-4c60-ab55-0c43a28bb0e9 req-abd24adf-f7f6-46d2-ac48-3987fa56f93a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b1a84290-3520-427e-af49-f380d2a144bb", "name": "network-vif-plugged", "status": "completed", "tag": "b5aa065e-e228-4681-909e-bd39389938fd"}]} {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:36:12.056274 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [req-f0bc5923-6fb3-4c60-ab55-0c43a28bb0e9 req-abd24adf-f7f6-46d2-ac48-3987fa56f93a service nova] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:36:12.057307 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [req-f0bc5923-6fb3-4c60-ab55-0c43a28bb0e9 req-abd24adf-f7f6-46d2-ac48-3987fa56f93a service nova] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:36:12.071164 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.compute.server_external_events [req-f0bc5923-6fb3-4c60-ab55-0c43a28bb0e9 req-abd24adf-f7f6-46d2-ac48-3987fa56f93a service nova] Creating event network-vif-plugged:b5aa065e-e228-4681-909e-bd39389938fd for instance b1a84290-3520-427e-af49-f380d2a144bb on hv-cinder-83754 Jul 18 10:36:12.076678 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [req-f0bc5923-6fb3-4c60-ab55-0c43a28bb0e9 req-abd24adf-f7f6-46d2-ac48-3987fa56f93a service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049244 Jul 18 10:36:12.077273 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 458/918] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jul 18 10:36:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:36:12.424124 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-917953e7-887f-48c4-9b36-31b17ebd2bda tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:36:12.424947 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-917953e7-887f-48c4-9b36-31b17ebd2bda tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] [instance: b1a84290-3520-427e-af49-f380d2a144bb] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:36:12.432183 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-917953e7-887f-48c4-9b36-31b17ebd2bda tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:36:12.433053 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-917953e7-887f-48c4-9b36-31b17ebd2bda tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:36:12.433862 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-917953e7-887f-48c4-9b36-31b17ebd2bda tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:36:12.434302 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-917953e7-887f-48c4-9b36-31b17ebd2bda tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:36:12.635826 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-917953e7-887f-48c4-9b36-31b17ebd2bda tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:36:12.644725 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-917953e7-887f-48c4-9b36-31b17ebd2bda tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:36:12.646728 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-917953e7-887f-48c4-9b36-31b17ebd2bda tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:36:12.648575 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-917953e7-887f-48c4-9b36-31b17ebd2bda tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] 10.222.0.33 "GET /compute/v2.1/servers/b1a84290-3520-427e-af49-f380d2a144bb" status: 200 len: 1809 microversion: 2.20 time: 0.228588 Jul 18 10:36:12.649512 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 461/919] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jul 18 10:36:12 2022] GET /compute/v2.1/servers/b1a84290-3520-427e-af49-f380d2a144bb => generated 1809 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:36:13.668802 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-a57984bb-7c9c-4550-91bc-c3447b1224db tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:36:13.669503 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-a57984bb-7c9c-4550-91bc-c3447b1224db tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] [instance: b1a84290-3520-427e-af49-f380d2a144bb] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:36:13.676653 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-a57984bb-7c9c-4550-91bc-c3447b1224db tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:36:13.677102 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-a57984bb-7c9c-4550-91bc-c3447b1224db tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:36:13.677873 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-a57984bb-7c9c-4550-91bc-c3447b1224db tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:36:13.678314 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-a57984bb-7c9c-4550-91bc-c3447b1224db tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:36:13.826192 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-a57984bb-7c9c-4550-91bc-c3447b1224db tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:36:13.835696 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-a57984bb-7c9c-4550-91bc-c3447b1224db tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:36:13.837232 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-a57984bb-7c9c-4550-91bc-c3447b1224db tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:36:13.838391 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-a57984bb-7c9c-4550-91bc-c3447b1224db tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] 10.222.0.33 "GET /compute/v2.1/servers/b1a84290-3520-427e-af49-f380d2a144bb" status: 200 len: 1809 microversion: 2.20 time: 0.173990 Jul 18 10:36:13.839274 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 459/920] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jul 18 10:36:13 2022] GET /compute/v2.1/servers/b1a84290-3520-427e-af49-f380d2a144bb => generated 1809 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:36:14.858211 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-1b74470d-25dc-439c-82fb-610569986d6e tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:36:14.858893 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-1b74470d-25dc-439c-82fb-610569986d6e tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] [instance: b1a84290-3520-427e-af49-f380d2a144bb] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:36:14.865877 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-1b74470d-25dc-439c-82fb-610569986d6e tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:36:14.865877 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-1b74470d-25dc-439c-82fb-610569986d6e tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:36:14.867838 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-1b74470d-25dc-439c-82fb-610569986d6e tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:36:14.868288 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-1b74470d-25dc-439c-82fb-610569986d6e tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:36:15.006205 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-1b74470d-25dc-439c-82fb-610569986d6e tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:36:15.014600 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-1b74470d-25dc-439c-82fb-610569986d6e tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:36:15.016038 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-1b74470d-25dc-439c-82fb-610569986d6e tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:36:15.017745 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-1b74470d-25dc-439c-82fb-610569986d6e tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] 10.222.0.33 "GET /compute/v2.1/servers/b1a84290-3520-427e-af49-f380d2a144bb" status: 200 len: 1796 microversion: 2.20 time: 0.162865 Jul 18 10:36:15.018553 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 462/921] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jul 18 10:36:14 2022] GET /compute/v2.1/servers/b1a84290-3520-427e-af49-f380d2a144bb => generated 1796 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 10:36:56.146572 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-9e4977aa-d346-45b7-b444-df3dd2a5627e tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:36:56.148033 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-9e4977aa-d346-45b7-b444-df3dd2a5627e tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] [instance: b1a84290-3520-427e-af49-f380d2a144bb] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:36:56.154390 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG dbcounter [-] [117880] Writing DB stats nova_api:SELECT=17 {{(pid=117880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:36:56.155470 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG dbcounter [-] [117880] Writing DB stats nova_cell1:SELECT=68 {{(pid=117880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:36:56.158410 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-9e4977aa-d346-45b7-b444-df3dd2a5627e tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:36:56.160335 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-9e4977aa-d346-45b7-b444-df3dd2a5627e tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:36:56.161258 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-9e4977aa-d346-45b7-b444-df3dd2a5627e tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:36:56.162188 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-9e4977aa-d346-45b7-b444-df3dd2a5627e tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:36:56.196355 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-9e4977aa-d346-45b7-b444-df3dd2a5627e tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] 10.222.0.33 "GET /compute/v2.1/servers/b1a84290-3520-427e-af49-f380d2a144bb/os-volume_attachments/90f960a6-ef49-4631-80eb-500ad04d5001" status: 200 len: 194 microversion: 2.20 time: 0.055233 Jul 18 10:36:56.196984 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 460/922] 10.222.0.33 () {60 vars in 1453 bytes} [Mon Jul 18 10:36:56 2022] GET /compute/v2.1/servers/b1a84290-3520-427e-af49-f380d2a144bb/os-volume_attachments/90f960a6-ef49-4631-80eb-500ad04d5001 => generated 194 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 10:36:56.266017 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-1c61bfe9-3aaa-4b4a-8e9f-3d45a95ee86d tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:36:56.266542 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-1c61bfe9-3aaa-4b4a-8e9f-3d45a95ee86d tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] [instance: b1a84290-3520-427e-af49-f380d2a144bb] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:36:56.272520 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG dbcounter [-] [117879] Writing DB stats nova_api:SELECT=10 {{(pid=117879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:36:56.273485 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG dbcounter [-] [117879] Writing DB stats nova_cell1:SELECT=20 {{(pid=117879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:36:56.275103 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-1c61bfe9-3aaa-4b4a-8e9f-3d45a95ee86d tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:36:56.275729 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-1c61bfe9-3aaa-4b4a-8e9f-3d45a95ee86d tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:36:56.276702 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-1c61bfe9-3aaa-4b4a-8e9f-3d45a95ee86d tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:36:56.277146 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-1c61bfe9-3aaa-4b4a-8e9f-3d45a95ee86d tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:36:56.368860 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.objects.instance [None req-1c61bfe9-3aaa-4b4a-8e9f-3d45a95ee86d tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lazy-loading 'services' on Instance uuid b1a84290-3520-427e-af49-f380d2a144bb {{(pid=117879) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 10:36:56.449079 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-1c61bfe9-3aaa-4b4a-8e9f-3d45a95ee86d tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] 10.222.0.33 "DELETE /compute/v2.1/servers/b1a84290-3520-427e-af49-f380d2a144bb/os-volume_attachments/90f960a6-ef49-4631-80eb-500ad04d5001" status: 202 len: 0 microversion: 2.20 time: 0.186644 Jul 18 10:36:56.449681 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 463/923] 10.222.0.33 () {60 vars in 1456 bytes} [Mon Jul 18 10:36:56 2022] DELETE /compute/v2.1/servers/b1a84290-3520-427e-af49-f380d2a144bb/os-volume_attachments/90f960a6-ef49-4631-80eb-500ad04d5001 => generated 0 bytes in 188 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 18 10:36:56.459118 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-009d4c65-a491-4ccb-9453-698ab0ea87e7 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:36:56.460049 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-009d4c65-a491-4ccb-9453-698ab0ea87e7 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] [instance: b1a84290-3520-427e-af49-f380d2a144bb] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:36:56.466406 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-009d4c65-a491-4ccb-9453-698ab0ea87e7 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:36:56.466901 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-009d4c65-a491-4ccb-9453-698ab0ea87e7 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:36:56.467706 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-009d4c65-a491-4ccb-9453-698ab0ea87e7 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:36:56.468131 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-009d4c65-a491-4ccb-9453-698ab0ea87e7 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:36:56.509271 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-009d4c65-a491-4ccb-9453-698ab0ea87e7 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] 10.222.0.33 "GET /compute/v2.1/servers/b1a84290-3520-427e-af49-f380d2a144bb/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054821 Jul 18 10:36:56.509896 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 461/924] 10.222.0.33 () {60 vars in 1342 bytes} [Mon Jul 18 10:36:56 2022] GET /compute/v2.1/servers/b1a84290-3520-427e-af49-f380d2a144bb/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 10:36:57.523605 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-b9d2ee72-8c5e-4dd6-9145-b241077b3e8a tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:36:57.524958 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-b9d2ee72-8c5e-4dd6-9145-b241077b3e8a tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] [instance: b1a84290-3520-427e-af49-f380d2a144bb] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:36:57.532539 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-b9d2ee72-8c5e-4dd6-9145-b241077b3e8a tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:36:57.532991 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-b9d2ee72-8c5e-4dd6-9145-b241077b3e8a tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:36:57.533758 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-b9d2ee72-8c5e-4dd6-9145-b241077b3e8a tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:36:57.534430 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-b9d2ee72-8c5e-4dd6-9145-b241077b3e8a tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:36:57.568837 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-b9d2ee72-8c5e-4dd6-9145-b241077b3e8a tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] 10.222.0.33 "GET /compute/v2.1/servers/b1a84290-3520-427e-af49-f380d2a144bb/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.051368 Jul 18 10:36:57.571586 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 464/925] 10.222.0.33 () {60 vars in 1342 bytes} [Mon Jul 18 10:36:57 2022] GET /compute/v2.1/servers/b1a84290-3520-427e-af49-f380d2a144bb/os-volume_attachments => generated 25 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:36:57.638064 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-b8019904-8b20-41b1-8423-fa412030ec07 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:36:57.638937 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-b8019904-8b20-41b1-8423-fa412030ec07 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] [instance: b1a84290-3520-427e-af49-f380d2a144bb] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:36:57.646474 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-b8019904-8b20-41b1-8423-fa412030ec07 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:36:57.647164 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-b8019904-8b20-41b1-8423-fa412030ec07 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:36:57.648813 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-b8019904-8b20-41b1-8423-fa412030ec07 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:36:57.649436 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-b8019904-8b20-41b1-8423-fa412030ec07 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:36:57.682461 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-b8019904-8b20-41b1-8423-fa412030ec07 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] [instance: b1a84290-3520-427e-af49-f380d2a144bb] Going to try to terminate instance {{(pid=117880) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 10:36:57.793922 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-b8019904-8b20-41b1-8423-fa412030ec07 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] 10.222.0.33 "DELETE /compute/v2.1/servers/b1a84290-3520-427e-af49-f380d2a144bb" status: 204 len: 0 microversion: 2.20 time: 0.160539 Jul 18 10:36:57.794889 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 462/926] 10.222.0.33 () {60 vars in 1279 bytes} [Mon Jul 18 10:36:57 2022] DELETE /compute/v2.1/servers/b1a84290-3520-427e-af49-f380d2a144bb => generated 0 bytes in 162 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 18 10:36:57.805630 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-f38c2c84-b192-4782-8c84-d3f0955c0847 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:36:57.811041 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-f38c2c84-b192-4782-8c84-d3f0955c0847 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] [instance: b1a84290-3520-427e-af49-f380d2a144bb] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:36:57.848478 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-f38c2c84-b192-4782-8c84-d3f0955c0847 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:36:57.850725 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-f38c2c84-b192-4782-8c84-d3f0955c0847 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:36:57.852420 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-f38c2c84-b192-4782-8c84-d3f0955c0847 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:36:57.853688 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-f38c2c84-b192-4782-8c84-d3f0955c0847 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:36:57.999135 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-f38c2c84-b192-4782-8c84-d3f0955c0847 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:36:58.007356 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-f38c2c84-b192-4782-8c84-d3f0955c0847 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:36:58.008725 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-f38c2c84-b192-4782-8c84-d3f0955c0847 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:36:58.010647 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-f38c2c84-b192-4782-8c84-d3f0955c0847 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] 10.222.0.33 "GET /compute/v2.1/servers/b1a84290-3520-427e-af49-f380d2a144bb" status: 200 len: 1724 microversion: 2.20 time: 0.209600 Jul 18 10:36:58.011385 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 465/927] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jul 18 10:36:57 2022] GET /compute/v2.1/servers/b1a84290-3520-427e-af49-f380d2a144bb => generated 1724 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:36:59.030330 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-5e6bc2f9-17ec-4476-a9ab-730719fb5868 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:36:59.031145 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-5e6bc2f9-17ec-4476-a9ab-730719fb5868 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] [instance: b1a84290-3520-427e-af49-f380d2a144bb] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:36:59.037572 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-5e6bc2f9-17ec-4476-a9ab-730719fb5868 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:36:59.038025 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-5e6bc2f9-17ec-4476-a9ab-730719fb5868 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:36:59.038801 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-5e6bc2f9-17ec-4476-a9ab-730719fb5868 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:36:59.039231 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-5e6bc2f9-17ec-4476-a9ab-730719fb5868 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:36:59.190885 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-5e6bc2f9-17ec-4476-a9ab-730719fb5868 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:36:59.202441 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-5e6bc2f9-17ec-4476-a9ab-730719fb5868 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:36:59.204238 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-5e6bc2f9-17ec-4476-a9ab-730719fb5868 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:36:59.205429 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-5e6bc2f9-17ec-4476-a9ab-730719fb5868 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] 10.222.0.33 "GET /compute/v2.1/servers/b1a84290-3520-427e-af49-f380d2a144bb" status: 200 len: 1724 microversion: 2.20 time: 0.179882 Jul 18 10:36:59.205971 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 463/928] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jul 18 10:36:59 2022] GET /compute/v2.1/servers/b1a84290-3520-427e-af49-f380d2a144bb => generated 1724 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:37:00.223409 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-5c1b33e4-9a2f-488a-8347-fd988e3741b3 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:37:00.225478 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-5c1b33e4-9a2f-488a-8347-fd988e3741b3 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] [instance: b1a84290-3520-427e-af49-f380d2a144bb] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:37:00.233601 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-5c1b33e4-9a2f-488a-8347-fd988e3741b3 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:37:00.234234 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-5c1b33e4-9a2f-488a-8347-fd988e3741b3 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:37:00.235180 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-5c1b33e4-9a2f-488a-8347-fd988e3741b3 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:37:00.235767 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-5c1b33e4-9a2f-488a-8347-fd988e3741b3 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:37:00.492985 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-5c1b33e4-9a2f-488a-8347-fd988e3741b3 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:37:00.504567 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-5c1b33e4-9a2f-488a-8347-fd988e3741b3 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:37:00.507045 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-5c1b33e4-9a2f-488a-8347-fd988e3741b3 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:37:00.508229 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-5c1b33e4-9a2f-488a-8347-fd988e3741b3 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] 10.222.0.33 "GET /compute/v2.1/servers/b1a84290-3520-427e-af49-f380d2a144bb" status: 200 len: 1724 microversion: 2.20 time: 0.288886 Jul 18 10:37:00.508816 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 466/929] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jul 18 10:37:00 2022] GET /compute/v2.1/servers/b1a84290-3520-427e-af49-f380d2a144bb => generated 1724 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 10:37:01.149369 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [req-fd3bbac0-e455-4b7d-845d-dfbceb86eea4 req-9ff818c0-5547-4443-9adc-42f871097967 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b1a84290-3520-427e-af49-f380d2a144bb", "name": "network-vif-deleted", "tag": "b5aa065e-e228-4681-909e-bd39389938fd"}]} {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:37:01.164525 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [req-fd3bbac0-e455-4b7d-845d-dfbceb86eea4 req-9ff818c0-5547-4443-9adc-42f871097967 service nova] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:37:01.166523 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [req-fd3bbac0-e455-4b7d-845d-dfbceb86eea4 req-9ff818c0-5547-4443-9adc-42f871097967 service nova] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:37:01.188728 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.compute.server_external_events [req-fd3bbac0-e455-4b7d-845d-dfbceb86eea4 req-9ff818c0-5547-4443-9adc-42f871097967 service nova] Creating event network-vif-deleted:b5aa065e-e228-4681-909e-bd39389938fd for instance b1a84290-3520-427e-af49-f380d2a144bb on hv-cinder-83754 Jul 18 10:37:01.193883 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [req-fd3bbac0-e455-4b7d-845d-dfbceb86eea4 req-9ff818c0-5547-4443-9adc-42f871097967 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049162 Jul 18 10:37:01.194789 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 464/930] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jul 18 10:37:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:37:01.527534 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-d9cdd96c-57dd-432a-bcf1-5aa3859c3272 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:37:01.528163 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-d9cdd96c-57dd-432a-bcf1-5aa3859c3272 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] [instance: b1a84290-3520-427e-af49-f380d2a144bb] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:37:01.535152 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-d9cdd96c-57dd-432a-bcf1-5aa3859c3272 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:37:01.535645 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-d9cdd96c-57dd-432a-bcf1-5aa3859c3272 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:37:01.537016 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-d9cdd96c-57dd-432a-bcf1-5aa3859c3272 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:37:01.537460 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-d9cdd96c-57dd-432a-bcf1-5aa3859c3272 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:37:01.580705 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-d9cdd96c-57dd-432a-bcf1-5aa3859c3272 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:37:01.581249 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-d9cdd96c-57dd-432a-bcf1-5aa3859c3272 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:37:01.581789 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.objects.instance [None req-d9cdd96c-57dd-432a-bcf1-5aa3859c3272 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lazy-loading 'fault' on Instance uuid b1a84290-3520-427e-af49-f380d2a144bb {{(pid=117879) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 10:37:01.676476 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-d9cdd96c-57dd-432a-bcf1-5aa3859c3272 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:37:01.695356 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-d9cdd96c-57dd-432a-bcf1-5aa3859c3272 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:37:01.697531 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-d9cdd96c-57dd-432a-bcf1-5aa3859c3272 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:37:01.700122 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-d9cdd96c-57dd-432a-bcf1-5aa3859c3272 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] 10.222.0.33 "GET /compute/v2.1/servers/b1a84290-3520-427e-af49-f380d2a144bb" status: 200 len: 1372 microversion: 2.20 time: 0.176169 Jul 18 10:37:01.701236 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 467/931] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jul 18 10:37:01 2022] GET /compute/v2.1/servers/b1a84290-3520-427e-af49-f380d2a144bb => generated 1372 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:37:02.719660 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-cfc85f5a-80b9-444d-8682-04c73c43b8cb tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:37:02.720389 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-cfc85f5a-80b9-444d-8682-04c73c43b8cb tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] [instance: b1a84290-3520-427e-af49-f380d2a144bb] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:37:02.726801 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-cfc85f5a-80b9-444d-8682-04c73c43b8cb tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:37:02.727249 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-cfc85f5a-80b9-444d-8682-04c73c43b8cb tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:37:02.728007 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-cfc85f5a-80b9-444d-8682-04c73c43b8cb tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:37:02.728440 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-cfc85f5a-80b9-444d-8682-04c73c43b8cb tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:37:02.745370 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.wsgi [None req-cfc85f5a-80b9-444d-8682-04c73c43b8cb tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] HTTP exception thrown: Instance b1a84290-3520-427e-af49-f380d2a144bb could not be found. Jul 18 10:37:02.747100 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-cfc85f5a-80b9-444d-8682-04c73c43b8cb tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Request method failure captured: Jul 18 10:37:02.747100 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: request: GET /compute/v2.1/servers/b1a84290-3520-427e-af49-f380d2a144bb HTTP/1.1 Jul 18 10:37:02.747100 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: Accept: application/json Jul 18 10:37:02.747100 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: Accept-Encoding: identity Jul 18 10:37:02.747100 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: Connection: close Jul 18 10:37:02.747100 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: Content-Length: 0 Jul 18 10:37:02.747100 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: Content-Type: application/json Jul 18 10:37:02.747100 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: Host: 10.222.0.33 Jul 18 10:37:02.747100 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: Openstack-System-Scope: None Jul 18 10:37:02.747100 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: User-Agent: python-urllib3/1.26.9 Jul 18 10:37:02.747100 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Auth-Token: gAAAAABi1TcnBAPlaPHtdv5tIZlRtT0XkCSp1cYOzJpQ75bhg4uyzEacqN1-FLjMcQVoiH0DbKD4MJLRgIlPoR64pKZaLn9i6i8VTsz7xjFqS-WjgWAPUuRVb7FZ5Py6JNNB81cGYGStEleWTuQAnU5tzMZ7b50tk85d9K2dSp0Bw83-FfBykmg Jul 18 10:37:02.747100 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Domain-Id: None Jul 18 10:37:02.747100 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Domain-Name: None Jul 18 10:37:02.747100 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Identity-Status: Confirmed Jul 18 10:37:02.747100 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Is-Admin-Project: True Jul 18 10:37:02.747100 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Openstack-Nova-Api-Version: 2.20 Jul 18 10:37:02.747100 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Project-Domain-Id: default Jul 18 10:37:02.747100 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Project-Domain-Name: Default Jul 18 10:37:02.747100 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Project-Id: feefb94984d54cbbaa70b963d956a520 Jul 18 10:37:02.747100 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-609182469 Jul 18 10:37:02.747100 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Role: member,reader Jul 18 10:37:02.747100 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Roles: member,reader Jul 18 10:37:02.748990 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/feefb94984d54cbbaa70b963d956a520"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/feefb94984d54cbbaa70b963d956a520"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/feefb94984d54cbbaa70b963d956a520"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_feefb94984d54cbbaa70b963d956a520"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jul 18 10:37:02.748990 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Tenant: tempest-AttachVolumeShelveTestJSON-609182469 Jul 18 10:37:02.748990 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Tenant-Id: feefb94984d54cbbaa70b963d956a520 Jul 18 10:37:02.748990 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-609182469 Jul 18 10:37:02.748990 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-User: tempest-AttachVolumeShelveTestJSON-609182469-project Jul 18 10:37:02.748990 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-User-Domain-Id: default Jul 18 10:37:02.748990 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-User-Domain-Name: Default Jul 18 10:37:02.748990 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-User-Id: cacc328f0f3540299310a0e53afe6acb Jul 18 10:37:02.748990 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-User-Name: tempest-AttachVolumeShelveTestJSON-609182469-project Jul 18 10:37:02.748990 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: method: > Jul 18 10:37:02.748990 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: exception: Instance b1a84290-3520-427e-af49-f380d2a144bb could not be found. Jul 18 10:37:02.748990 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: action_args: {'id': 'b1a84290-3520-427e-af49-f380d2a144bb'} Jul 18 10:37:02.750466 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 10:37:02.750466 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:37:02.750466 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 10:37:02.750466 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 10:37:02.750466 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 10:37:02.750466 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 10:37:02.750466 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 10:37:02.750466 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 10:37:02.750466 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 10:37:02.750466 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 10:37:02.750466 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b1a84290-3520-427e-af49-f380d2a144bb could not be found. Jul 18 10:37:02.750466 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi Jul 18 10:37:02.750466 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:37:02.750466 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi Jul 18 10:37:02.750466 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:37:02.750466 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:37:02.750466 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:37:02.750466 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 10:37:02.750466 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 10:37:02.750466 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 10:37:02.752091 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 10:37:02.752091 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 10:37:02.752091 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 10:37:02.752091 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 10:37:02.752091 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 10:37:02.752091 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 10:37:02.752091 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 10:37:02.752091 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b1a84290-3520-427e-af49-f380d2a144bb could not be found. Jul 18 10:37:02.752091 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi Jul 18 10:37:02.752091 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:37:02.752091 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi Jul 18 10:37:02.752091 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:37:02.752091 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:37:02.752091 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:37:02.752091 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 10:37:02.752091 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 10:37:02.752091 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b1a84290-3520-427e-af49-f380d2a144bb could not be found. Jul 18 10:37:02.752091 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi Jul 18 10:37:02.754553 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-cfc85f5a-80b9-444d-8682-04c73c43b8cb tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Returning 404 to user: Instance b1a84290-3520-427e-af49-f380d2a144bb could not be found. {{(pid=117880) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 10:37:02.754553 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-cfc85f5a-80b9-444d-8682-04c73c43b8cb tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] 10.222.0.33 "GET /compute/v2.1/servers/b1a84290-3520-427e-af49-f380d2a144bb" status: 404 len: 111 microversion: 2.20 time: 0.033535 Jul 18 10:37:02.754553 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 465/932] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jul 18 10:37:02 2022] GET /compute/v2.1/servers/b1a84290-3520-427e-af49-f380d2a144bb => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 18 10:37:02.758978 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-85369b8c-6b7b-433e-a503-0fcd58882e4a tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Calling method '.version_select at 0x7f9f49fd3820>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:37:02.785580 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-85369b8c-6b7b-433e-a503-0fcd58882e4a tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1613020057" status: 204 len: 0 microversion: 2.20 time: 0.031999 Jul 18 10:37:02.786308 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 468/933] 10.222.0.33 () {60 vars in 1261 bytes} [Mon Jul 18 10:37:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1613020057 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jul 18 10:37:03.576727 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-953348a8-2d35-4877-9b3e-35e8363d711c tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Action: 'create', calling method: .version_select at 0x7f9f49f47f70>, body: {"keypair": {"name": "tempest-keypair-2142457572", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK1Ef+C8xwuGzCSkWDH640wL69t7LVWvv2VWmzIcNhZX8H5mdWn/mJE+AzFwLP3Zrc7IOkDJSwsivujMtP3Ycoed3k2Wij/gtO4lAJinG0cve4RNJif9Hp9hJGDQ/+7yGw=="}} {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:37:03.591054 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.quota [None req-953348a8-2d35-4877-9b3e-35e8363d711c tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Getting quotas for project feefb94984d54cbbaa70b963d956a520. Resources: {'key_pairs'} {{(pid=117880) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 10:37:03.595150 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.quota [None req-953348a8-2d35-4877-9b3e-35e8363d711c tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Getting quotas for user cacc328f0f3540299310a0e53afe6acb and project feefb94984d54cbbaa70b963d956a520. Resources: {'key_pairs'} {{(pid=117880) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 10:37:03.621272 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-953348a8-2d35-4877-9b3e-35e8363d711c tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.048849 Jul 18 10:37:03.621967 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 466/934] 10.222.0.33 () {62 vars in 1199 bytes} [Mon Jul 18 10:37:03 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 50 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 18 10:37:05.010961 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-b7ccaeda-5993-44d8-8ee2-a4cf263aac84 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1549677751", "imageRef": "2cb02169-9999-411b-8c74-f88c068960fc", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "247d0ee0-142b-4d40-8e91-ea541c052e58"}], "security_groups": [{"name": "tempest-securitygroup--1495758066"}], "key_name": "tempest-keypair-2142457572", "user_data": "}} {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:37:05.119171 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.network.neutron [None req-b7ccaeda-5993-44d8-8ee2-a4cf263aac84 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] validate_networks() for [('247d0ee0-142b-4d40-8e91-ea541c052e58', None, None, None, None, None)] {{(pid=117879) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 10:37:05.516198 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.virt.hardware [None req-b7ccaeda-5993-44d8-8ee2-a4cf263aac84 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Flavor limits 0:0:0 {{(pid=117879) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 10:37:05.516679 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.virt.hardware [None req-b7ccaeda-5993-44d8-8ee2-a4cf263aac84 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Image limits 0:0:0 {{(pid=117879) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 10:37:05.517152 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.virt.hardware [None req-b7ccaeda-5993-44d8-8ee2-a4cf263aac84 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Flavor pref 0:0:0 {{(pid=117879) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 10:37:05.517558 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.virt.hardware [None req-b7ccaeda-5993-44d8-8ee2-a4cf263aac84 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Image pref 0:0:0 {{(pid=117879) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 10:37:05.517985 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.virt.hardware [None req-b7ccaeda-5993-44d8-8ee2-a4cf263aac84 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117879) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 10:37:05.527839 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-b7ccaeda-5993-44d8-8ee2-a4cf263aac84 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:37:05.528356 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-b7ccaeda-5993-44d8-8ee2-a4cf263aac84 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:37:05.529563 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-b7ccaeda-5993-44d8-8ee2-a4cf263aac84 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:37:05.530091 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-b7ccaeda-5993-44d8-8ee2-a4cf263aac84 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:37:05.549092 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.quota [None req-b7ccaeda-5993-44d8-8ee2-a4cf263aac84 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Getting quotas for project feefb94984d54cbbaa70b963d956a520. Resources: {'ram', 'cores', 'instances'} {{(pid=117879) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 10:37:05.553915 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.quota [None req-b7ccaeda-5993-44d8-8ee2-a4cf263aac84 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Getting quotas for user cacc328f0f3540299310a0e53afe6acb and project feefb94984d54cbbaa70b963d956a520. Resources: {'ram', 'cores', 'instances'} {{(pid=117879) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 10:37:05.565386 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-b7ccaeda-5993-44d8-8ee2-a4cf263aac84 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Going to run 1 instances... {{(pid=117879) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 10:37:05.567736 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-b7ccaeda-5993-44d8-8ee2-a4cf263aac84 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] [instance: 7c4da4be-98d3-4976-97aa-a3ca9b8ddf96] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2cb02169-9999-411b-8c74-f88c068960fc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117879) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 10:37:05.614380 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-b7ccaeda-5993-44d8-8ee2-a4cf263aac84 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.608091 Jul 18 10:37:05.615028 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 469/935] 10.222.0.33 () {62 vars in 1187 bytes} [Mon Jul 18 10:37:05 2022] POST /compute/v2.1/servers => generated 402 bytes in 610 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Jul 18 10:37:05.626428 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-ede6ae7b-0691-439e-b310-4152e60fff19 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:37:05.627271 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-ede6ae7b-0691-439e-b310-4152e60fff19 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] [instance: 7c4da4be-98d3-4976-97aa-a3ca9b8ddf96] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:37:05.693740 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-ede6ae7b-0691-439e-b310-4152e60fff19 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:37:05.703344 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-ede6ae7b-0691-439e-b310-4152e60fff19 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:37:05.705424 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-ede6ae7b-0691-439e-b310-4152e60fff19 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:37:05.707702 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-ede6ae7b-0691-439e-b310-4152e60fff19 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] 10.222.0.33 "GET /compute/v2.1/servers/7c4da4be-98d3-4976-97aa-a3ca9b8ddf96" status: 200 len: 1282 microversion: 2.20 time: 0.085084 Jul 18 10:37:05.709281 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 467/936] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jul 18 10:37:05 2022] GET /compute/v2.1/servers/7c4da4be-98d3-4976-97aa-a3ca9b8ddf96 => generated 1282 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 10:37:06.727927 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-9660c32e-843c-41ff-a640-5f072b184ca7 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:37:06.729510 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-9660c32e-843c-41ff-a640-5f072b184ca7 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] [instance: 7c4da4be-98d3-4976-97aa-a3ca9b8ddf96] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:37:06.736146 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-9660c32e-843c-41ff-a640-5f072b184ca7 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:37:06.737006 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-9660c32e-843c-41ff-a640-5f072b184ca7 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:37:06.738054 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-9660c32e-843c-41ff-a640-5f072b184ca7 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:37:06.738751 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-9660c32e-843c-41ff-a640-5f072b184ca7 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:37:06.841660 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-9660c32e-843c-41ff-a640-5f072b184ca7 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:37:06.852188 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-9660c32e-843c-41ff-a640-5f072b184ca7 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:37:06.854121 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-9660c32e-843c-41ff-a640-5f072b184ca7 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:37:06.855625 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-9660c32e-843c-41ff-a640-5f072b184ca7 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] 10.222.0.33 "GET /compute/v2.1/servers/7c4da4be-98d3-4976-97aa-a3ca9b8ddf96" status: 200 len: 1342 microversion: 2.20 time: 0.132949 Jul 18 10:37:06.856741 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 470/937] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jul 18 10:37:06 2022] GET /compute/v2.1/servers/7c4da4be-98d3-4976-97aa-a3ca9b8ddf96 => generated 1342 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:37:07.875266 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-0b34cef2-a626-4aa2-9e6e-1c6ad7838208 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:37:07.875880 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-0b34cef2-a626-4aa2-9e6e-1c6ad7838208 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] [instance: 7c4da4be-98d3-4976-97aa-a3ca9b8ddf96] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:37:07.887174 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-0b34cef2-a626-4aa2-9e6e-1c6ad7838208 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:37:07.887981 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-0b34cef2-a626-4aa2-9e6e-1c6ad7838208 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:37:07.888977 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-0b34cef2-a626-4aa2-9e6e-1c6ad7838208 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:37:07.889418 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-0b34cef2-a626-4aa2-9e6e-1c6ad7838208 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:37:08.133958 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-0b34cef2-a626-4aa2-9e6e-1c6ad7838208 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:37:08.142508 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-0b34cef2-a626-4aa2-9e6e-1c6ad7838208 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:37:08.144113 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-0b34cef2-a626-4aa2-9e6e-1c6ad7838208 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:37:08.145273 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-0b34cef2-a626-4aa2-9e6e-1c6ad7838208 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] 10.222.0.33 "GET /compute/v2.1/servers/7c4da4be-98d3-4976-97aa-a3ca9b8ddf96" status: 200 len: 1408 microversion: 2.20 time: 0.274388 Jul 18 10:37:08.145864 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 468/938] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jul 18 10:37:07 2022] GET /compute/v2.1/servers/7c4da4be-98d3-4976-97aa-a3ca9b8ddf96 => generated 1408 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:37:08.274367 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [req-01c4affa-3f01-4ff5-8b57-e256889d1b8f req-ac52ca3c-d2d4-4453-895e-9d8699398fdc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7c4da4be-98d3-4976-97aa-a3ca9b8ddf96", "tag": "1dcc8a67-356a-4505-8579-9742b691b360"}]} {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:37:08.288242 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [req-01c4affa-3f01-4ff5-8b57-e256889d1b8f req-ac52ca3c-d2d4-4453-895e-9d8699398fdc service nova] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:37:08.289025 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [req-01c4affa-3f01-4ff5-8b57-e256889d1b8f req-ac52ca3c-d2d4-4453-895e-9d8699398fdc service nova] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:37:08.305727 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.compute.server_external_events [req-01c4affa-3f01-4ff5-8b57-e256889d1b8f req-ac52ca3c-d2d4-4453-895e-9d8699398fdc service nova] Creating event network-changed:1dcc8a67-356a-4505-8579-9742b691b360 for instance 7c4da4be-98d3-4976-97aa-a3ca9b8ddf96 on hv-cinder-83754 Jul 18 10:37:08.312292 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [req-01c4affa-3f01-4ff5-8b57-e256889d1b8f req-ac52ca3c-d2d4-4453-895e-9d8699398fdc service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044532 Jul 18 10:37:08.313610 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 471/939] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jul 18 10:37:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:37:09.169182 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-5f9e52f0-6be8-4ba6-991e-a142b13cb93f tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:37:09.169785 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-5f9e52f0-6be8-4ba6-991e-a142b13cb93f tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] [instance: 7c4da4be-98d3-4976-97aa-a3ca9b8ddf96] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:37:09.182134 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-5f9e52f0-6be8-4ba6-991e-a142b13cb93f tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:37:09.182576 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-5f9e52f0-6be8-4ba6-991e-a142b13cb93f tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:37:09.183345 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-5f9e52f0-6be8-4ba6-991e-a142b13cb93f tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:37:09.183771 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-5f9e52f0-6be8-4ba6-991e-a142b13cb93f tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:37:09.396041 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-5f9e52f0-6be8-4ba6-991e-a142b13cb93f tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:37:09.404448 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-5f9e52f0-6be8-4ba6-991e-a142b13cb93f tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:37:09.406068 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-5f9e52f0-6be8-4ba6-991e-a142b13cb93f tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:37:09.407175 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-5f9e52f0-6be8-4ba6-991e-a142b13cb93f tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] 10.222.0.33 "GET /compute/v2.1/servers/7c4da4be-98d3-4976-97aa-a3ca9b8ddf96" status: 200 len: 1408 microversion: 2.20 time: 0.243098 Jul 18 10:37:09.407847 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 469/940] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jul 18 10:37:09 2022] GET /compute/v2.1/servers/7c4da4be-98d3-4976-97aa-a3ca9b8ddf96 => generated 1408 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:37:10.425365 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-832046aa-e14c-4c0d-af21-f52c522cb724 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:37:10.425957 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-832046aa-e14c-4c0d-af21-f52c522cb724 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] [instance: 7c4da4be-98d3-4976-97aa-a3ca9b8ddf96] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:37:10.432748 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-832046aa-e14c-4c0d-af21-f52c522cb724 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:37:10.433195 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-832046aa-e14c-4c0d-af21-f52c522cb724 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:37:10.433946 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-832046aa-e14c-4c0d-af21-f52c522cb724 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:37:10.434378 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-832046aa-e14c-4c0d-af21-f52c522cb724 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:37:10.570341 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-832046aa-e14c-4c0d-af21-f52c522cb724 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:37:10.578268 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-832046aa-e14c-4c0d-af21-f52c522cb724 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:37:10.579777 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-832046aa-e14c-4c0d-af21-f52c522cb724 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:37:10.580912 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-832046aa-e14c-4c0d-af21-f52c522cb724 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] 10.222.0.33 "GET /compute/v2.1/servers/7c4da4be-98d3-4976-97aa-a3ca9b8ddf96" status: 200 len: 1408 microversion: 2.20 time: 0.160284 Jul 18 10:37:10.581466 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 472/941] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jul 18 10:37:10 2022] GET /compute/v2.1/servers/7c4da4be-98d3-4976-97aa-a3ca9b8ddf96 => generated 1408 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:37:11.599904 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-b18a3428-845f-46cc-a5bc-2d9da988b66c tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:37:11.600431 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-b18a3428-845f-46cc-a5bc-2d9da988b66c tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] [instance: 7c4da4be-98d3-4976-97aa-a3ca9b8ddf96] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:37:11.607156 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-b18a3428-845f-46cc-a5bc-2d9da988b66c tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:37:11.607606 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-b18a3428-845f-46cc-a5bc-2d9da988b66c tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:37:11.608364 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-b18a3428-845f-46cc-a5bc-2d9da988b66c tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:37:11.608837 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-b18a3428-845f-46cc-a5bc-2d9da988b66c tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:37:11.743731 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-b18a3428-845f-46cc-a5bc-2d9da988b66c tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:37:11.751854 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-b18a3428-845f-46cc-a5bc-2d9da988b66c tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:37:11.753387 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-b18a3428-845f-46cc-a5bc-2d9da988b66c tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:37:11.754509 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-b18a3428-845f-46cc-a5bc-2d9da988b66c tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] 10.222.0.33 "GET /compute/v2.1/servers/7c4da4be-98d3-4976-97aa-a3ca9b8ddf96" status: 200 len: 1408 microversion: 2.20 time: 0.159204 Jul 18 10:37:11.755042 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 470/942] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jul 18 10:37:11 2022] GET /compute/v2.1/servers/7c4da4be-98d3-4976-97aa-a3ca9b8ddf96 => generated 1408 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:37:12.772142 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-fc9e44d9-875b-4ff8-84cd-d1f7fe6e9c3e tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:37:12.772784 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-fc9e44d9-875b-4ff8-84cd-d1f7fe6e9c3e tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] [instance: 7c4da4be-98d3-4976-97aa-a3ca9b8ddf96] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:37:12.779741 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-fc9e44d9-875b-4ff8-84cd-d1f7fe6e9c3e tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:37:12.780189 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-fc9e44d9-875b-4ff8-84cd-d1f7fe6e9c3e tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:37:12.780983 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-fc9e44d9-875b-4ff8-84cd-d1f7fe6e9c3e tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:37:12.781418 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-fc9e44d9-875b-4ff8-84cd-d1f7fe6e9c3e tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:37:12.916270 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-fc9e44d9-875b-4ff8-84cd-d1f7fe6e9c3e tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:37:12.924260 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-fc9e44d9-875b-4ff8-84cd-d1f7fe6e9c3e tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:37:12.925819 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-fc9e44d9-875b-4ff8-84cd-d1f7fe6e9c3e tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:37:12.926932 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-fc9e44d9-875b-4ff8-84cd-d1f7fe6e9c3e tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] 10.222.0.33 "GET /compute/v2.1/servers/7c4da4be-98d3-4976-97aa-a3ca9b8ddf96" status: 200 len: 1408 microversion: 2.20 time: 0.158792 Jul 18 10:37:12.927491 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 473/943] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jul 18 10:37:12 2022] GET /compute/v2.1/servers/7c4da4be-98d3-4976-97aa-a3ca9b8ddf96 => generated 1408 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:37:13.946024 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-8d244444-3838-4d35-804d-743da2aeaa0b tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:37:13.946628 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-8d244444-3838-4d35-804d-743da2aeaa0b tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] [instance: 7c4da4be-98d3-4976-97aa-a3ca9b8ddf96] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:37:13.953156 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-8d244444-3838-4d35-804d-743da2aeaa0b tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:37:13.953609 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-8d244444-3838-4d35-804d-743da2aeaa0b tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:37:13.954370 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-8d244444-3838-4d35-804d-743da2aeaa0b tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:37:13.954806 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-8d244444-3838-4d35-804d-743da2aeaa0b tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:37:14.088718 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-8d244444-3838-4d35-804d-743da2aeaa0b tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:37:14.096819 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-8d244444-3838-4d35-804d-743da2aeaa0b tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:37:14.098316 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-8d244444-3838-4d35-804d-743da2aeaa0b tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:37:14.099417 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-8d244444-3838-4d35-804d-743da2aeaa0b tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] 10.222.0.33 "GET /compute/v2.1/servers/7c4da4be-98d3-4976-97aa-a3ca9b8ddf96" status: 200 len: 1408 microversion: 2.20 time: 0.158024 Jul 18 10:37:14.100467 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 471/944] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jul 18 10:37:13 2022] GET /compute/v2.1/servers/7c4da4be-98d3-4976-97aa-a3ca9b8ddf96 => generated 1408 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:37:15.117150 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-79f38c6b-4e7e-48ee-9014-f4f6138cc226 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:37:15.117760 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-79f38c6b-4e7e-48ee-9014-f4f6138cc226 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] [instance: 7c4da4be-98d3-4976-97aa-a3ca9b8ddf96] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:37:15.124001 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-79f38c6b-4e7e-48ee-9014-f4f6138cc226 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:37:15.124453 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-79f38c6b-4e7e-48ee-9014-f4f6138cc226 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:37:15.125243 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-79f38c6b-4e7e-48ee-9014-f4f6138cc226 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:37:15.125709 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-79f38c6b-4e7e-48ee-9014-f4f6138cc226 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:37:15.262867 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-79f38c6b-4e7e-48ee-9014-f4f6138cc226 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:37:15.270779 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-79f38c6b-4e7e-48ee-9014-f4f6138cc226 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:37:15.272304 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-79f38c6b-4e7e-48ee-9014-f4f6138cc226 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:37:15.273481 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-79f38c6b-4e7e-48ee-9014-f4f6138cc226 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] 10.222.0.33 "GET /compute/v2.1/servers/7c4da4be-98d3-4976-97aa-a3ca9b8ddf96" status: 200 len: 1408 microversion: 2.20 time: 0.160302 Jul 18 10:37:15.274044 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 474/945] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jul 18 10:37:15 2022] GET /compute/v2.1/servers/7c4da4be-98d3-4976-97aa-a3ca9b8ddf96 => generated 1408 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:37:16.291626 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-c15e9b03-967e-4af8-9ee3-bf519341bf60 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:37:16.292377 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-c15e9b03-967e-4af8-9ee3-bf519341bf60 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] [instance: 7c4da4be-98d3-4976-97aa-a3ca9b8ddf96] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:37:16.294797 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG dbcounter [-] [117880] Writing DB stats nova_cell0:SELECT=6 {{(pid=117880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:37:16.300291 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-c15e9b03-967e-4af8-9ee3-bf519341bf60 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:37:16.300720 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-c15e9b03-967e-4af8-9ee3-bf519341bf60 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:37:16.301488 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-c15e9b03-967e-4af8-9ee3-bf519341bf60 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:37:16.301959 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-c15e9b03-967e-4af8-9ee3-bf519341bf60 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:37:16.338795 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [req-7682baef-f68f-4787-8979-eed000118aaf req-e73d16d8-4eda-47f5-b8ca-eb2ca40e165c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c4da4be-98d3-4976-97aa-a3ca9b8ddf96", "name": "network-vif-plugged", "status": "completed", "tag": "1dcc8a67-356a-4505-8579-9742b691b360"}]} {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:37:16.343896 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG dbcounter [-] [117879] Writing DB stats nova_cell0:SELECT=2 {{(pid=117879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:37:16.344626 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG dbcounter [-] [117879] Writing DB stats nova_cell0:SELECT=6 {{(pid=117879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:37:16.349767 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [req-7682baef-f68f-4787-8979-eed000118aaf req-e73d16d8-4eda-47f5-b8ca-eb2ca40e165c service nova] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:37:16.350215 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [req-7682baef-f68f-4787-8979-eed000118aaf req-e73d16d8-4eda-47f5-b8ca-eb2ca40e165c service nova] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:37:16.369042 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.compute.server_external_events [req-7682baef-f68f-4787-8979-eed000118aaf req-e73d16d8-4eda-47f5-b8ca-eb2ca40e165c service nova] Creating event network-vif-plugged:1dcc8a67-356a-4505-8579-9742b691b360 for instance 7c4da4be-98d3-4976-97aa-a3ca9b8ddf96 on hv-cinder-83754 Jul 18 10:37:16.375381 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [req-7682baef-f68f-4787-8979-eed000118aaf req-e73d16d8-4eda-47f5-b8ca-eb2ca40e165c service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039901 Jul 18 10:37:16.376465 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 475/946] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jul 18 10:37:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 10:37:16.444119 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-c15e9b03-967e-4af8-9ee3-bf519341bf60 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:37:16.452316 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-c15e9b03-967e-4af8-9ee3-bf519341bf60 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:37:16.453907 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-c15e9b03-967e-4af8-9ee3-bf519341bf60 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:37:16.455075 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-c15e9b03-967e-4af8-9ee3-bf519341bf60 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] 10.222.0.33 "GET /compute/v2.1/servers/7c4da4be-98d3-4976-97aa-a3ca9b8ddf96" status: 200 len: 1408 microversion: 2.20 time: 0.167894 Jul 18 10:37:16.455624 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 472/947] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jul 18 10:37:16 2022] GET /compute/v2.1/servers/7c4da4be-98d3-4976-97aa-a3ca9b8ddf96 => generated 1408 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:37:17.474799 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-f3e50cfc-4344-4b87-8709-c2316b9707e2 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:37:17.475398 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-f3e50cfc-4344-4b87-8709-c2316b9707e2 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] [instance: 7c4da4be-98d3-4976-97aa-a3ca9b8ddf96] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:37:17.482977 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-f3e50cfc-4344-4b87-8709-c2316b9707e2 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:37:17.483442 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-f3e50cfc-4344-4b87-8709-c2316b9707e2 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:37:17.484230 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-f3e50cfc-4344-4b87-8709-c2316b9707e2 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:37:17.484707 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-f3e50cfc-4344-4b87-8709-c2316b9707e2 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:37:17.620637 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-f3e50cfc-4344-4b87-8709-c2316b9707e2 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:37:17.628406 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-f3e50cfc-4344-4b87-8709-c2316b9707e2 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:37:17.629913 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-f3e50cfc-4344-4b87-8709-c2316b9707e2 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:37:17.631005 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-f3e50cfc-4344-4b87-8709-c2316b9707e2 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] 10.222.0.33 "GET /compute/v2.1/servers/7c4da4be-98d3-4976-97aa-a3ca9b8ddf96" status: 200 len: 1408 microversion: 2.20 time: 0.161800 Jul 18 10:37:17.631565 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 476/948] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jul 18 10:37:17 2022] GET /compute/v2.1/servers/7c4da4be-98d3-4976-97aa-a3ca9b8ddf96 => generated 1408 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:37:18.649774 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-7bc79243-bd33-477c-9491-82f8d252f8f3 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:37:18.650381 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-7bc79243-bd33-477c-9491-82f8d252f8f3 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] [instance: 7c4da4be-98d3-4976-97aa-a3ca9b8ddf96] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:37:18.656576 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-7bc79243-bd33-477c-9491-82f8d252f8f3 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:37:18.657052 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-7bc79243-bd33-477c-9491-82f8d252f8f3 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:37:18.657804 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-7bc79243-bd33-477c-9491-82f8d252f8f3 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:37:18.658235 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-7bc79243-bd33-477c-9491-82f8d252f8f3 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:37:18.786034 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-7bc79243-bd33-477c-9491-82f8d252f8f3 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:37:18.793946 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-7bc79243-bd33-477c-9491-82f8d252f8f3 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:37:18.795427 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-7bc79243-bd33-477c-9491-82f8d252f8f3 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:37:18.796590 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-7bc79243-bd33-477c-9491-82f8d252f8f3 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] 10.222.0.33 "GET /compute/v2.1/servers/7c4da4be-98d3-4976-97aa-a3ca9b8ddf96" status: 200 len: 1600 microversion: 2.20 time: 0.151225 Jul 18 10:37:18.797141 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 473/949] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jul 18 10:37:18 2022] GET /compute/v2.1/servers/7c4da4be-98d3-4976-97aa-a3ca9b8ddf96 => generated 1600 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:37:18.813393 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-70de41ce-5948-498a-b73d-65026babf13a tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:37:18.813889 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-70de41ce-5948-498a-b73d-65026babf13a tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] [instance: 7c4da4be-98d3-4976-97aa-a3ca9b8ddf96] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:37:18.820744 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-70de41ce-5948-498a-b73d-65026babf13a tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:37:18.821203 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-70de41ce-5948-498a-b73d-65026babf13a tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:37:18.821965 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-70de41ce-5948-498a-b73d-65026babf13a tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:37:18.822405 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-70de41ce-5948-498a-b73d-65026babf13a tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:37:18.900205 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-70de41ce-5948-498a-b73d-65026babf13a tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] 10.222.0.33 "GET /compute/v2.1/servers/7c4da4be-98d3-4976-97aa-a3ca9b8ddf96/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.090500 Jul 18 10:37:18.900763 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 477/950] 10.222.0.33 () {60 vars in 1315 bytes} [Mon Jul 18 10:37:18 2022] GET /compute/v2.1/servers/7c4da4be-98d3-4976-97aa-a3ca9b8ddf96/os-interface => generated 284 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 10:37:19.807176 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [req-8e6d3c75-1a46-4def-8570-d03d4b30f3f8 req-3bfbaa6f-1159-4a86-9b5b-557db7836624 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7c4da4be-98d3-4976-97aa-a3ca9b8ddf96", "tag": "1dcc8a67-356a-4505-8579-9742b691b360"}]} {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:37:19.815466 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [req-8e6d3c75-1a46-4def-8570-d03d4b30f3f8 req-3bfbaa6f-1159-4a86-9b5b-557db7836624 service nova] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:37:19.815899 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [req-8e6d3c75-1a46-4def-8570-d03d4b30f3f8 req-3bfbaa6f-1159-4a86-9b5b-557db7836624 service nova] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:37:19.826610 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.compute.server_external_events [req-8e6d3c75-1a46-4def-8570-d03d4b30f3f8 req-3bfbaa6f-1159-4a86-9b5b-557db7836624 service nova] Creating event network-changed:1dcc8a67-356a-4505-8579-9742b691b360 for instance 7c4da4be-98d3-4976-97aa-a3ca9b8ddf96 on hv-cinder-83754 Jul 18 10:37:19.831728 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [req-8e6d3c75-1a46-4def-8570-d03d4b30f3f8 req-3bfbaa6f-1159-4a86-9b5b-557db7836624 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028130 Jul 18 10:37:19.832409 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 474/951] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jul 18 10:37:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:37:27.933531 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-2a148cdf-2d60-44e0-a358-4ad55a50fa85 tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:37:27.934148 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-2a148cdf-2d60-44e0-a358-4ad55a50fa85 tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] [instance: 00da9ad2-aef2-4a2b-8ae8-51ee9e41e049] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:37:27.937480 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG dbcounter [-] [117879] Writing DB stats nova_api:SELECT=47,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=117879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:37:27.941615 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-2a148cdf-2d60-44e0-a358-4ad55a50fa85 tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:37:27.942071 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-2a148cdf-2d60-44e0-a358-4ad55a50fa85 tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:37:27.942859 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-2a148cdf-2d60-44e0-a358-4ad55a50fa85 tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:37:27.943280 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-2a148cdf-2d60-44e0-a358-4ad55a50fa85 tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:37:27.948193 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG dbcounter [-] [117879] Writing DB stats nova_cell1:SELECT=76,nova_cell1:INSERT=1 {{(pid=117879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:37:27.970325 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.objects.instance [None req-2a148cdf-2d60-44e0-a358-4ad55a50fa85 tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] Lazy-loading 'flavor' on Instance uuid 00da9ad2-aef2-4a2b-8ae8-51ee9e41e049 {{(pid=117879) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 10:37:28.064668 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-2a148cdf-2d60-44e0-a358-4ad55a50fa85 tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] 10.222.0.33 "POST /compute/v2.1/servers/00da9ad2-aef2-4a2b-8ae8-51ee9e41e049/action" status: 202 len: 0 microversion: 2.1 time: 0.135652 Jul 18 10:37:28.065570 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 478/952] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Jul 18 10:37:27 2022] POST /compute/v2.1/servers/00da9ad2-aef2-4a2b-8ae8-51ee9e41e049/action => generated 0 bytes in 137 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 10:37:28.084673 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-587cc229-20fd-4bad-bbeb-e4aa8d2416ea tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:37:28.085416 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-587cc229-20fd-4bad-bbeb-e4aa8d2416ea tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] [instance: 00da9ad2-aef2-4a2b-8ae8-51ee9e41e049] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:37:28.093411 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG dbcounter [-] [117880] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=117880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:37:28.098640 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-587cc229-20fd-4bad-bbeb-e4aa8d2416ea tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:37:28.099092 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-587cc229-20fd-4bad-bbeb-e4aa8d2416ea tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:37:28.099914 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-587cc229-20fd-4bad-bbeb-e4aa8d2416ea tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:37:28.100353 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-587cc229-20fd-4bad-bbeb-e4aa8d2416ea tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:37:28.111436 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG dbcounter [-] [117880] Writing DB stats nova_cell1:SELECT=75,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:37:28.261755 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-587cc229-20fd-4bad-bbeb-e4aa8d2416ea tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de7190c1ae524da280700ef2548a4a17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5628452a1ceb4af293ea96c187983fa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:37:28.270182 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-587cc229-20fd-4bad-bbeb-e4aa8d2416ea tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] 10.222.0.33 "GET /compute/v2.1/servers/00da9ad2-aef2-4a2b-8ae8-51ee9e41e049" status: 200 len: 1568 microversion: 2.1 time: 0.199879 Jul 18 10:37:28.270986 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 475/953] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:37:28 2022] GET /compute/v2.1/servers/00da9ad2-aef2-4a2b-8ae8-51ee9e41e049 => generated 1568 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:37:29.288449 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-47eb023d-d496-4b0e-be56-71279598b4c1 tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:37:29.289193 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-47eb023d-d496-4b0e-be56-71279598b4c1 tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] [instance: 00da9ad2-aef2-4a2b-8ae8-51ee9e41e049] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:37:29.295859 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-47eb023d-d496-4b0e-be56-71279598b4c1 tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:37:29.296313 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-47eb023d-d496-4b0e-be56-71279598b4c1 tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:37:29.297102 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-47eb023d-d496-4b0e-be56-71279598b4c1 tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:37:29.297542 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-47eb023d-d496-4b0e-be56-71279598b4c1 tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:37:29.435037 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-47eb023d-d496-4b0e-be56-71279598b4c1 tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de7190c1ae524da280700ef2548a4a17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5628452a1ceb4af293ea96c187983fa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:37:29.442550 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-47eb023d-d496-4b0e-be56-71279598b4c1 tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] 10.222.0.33 "GET /compute/v2.1/servers/00da9ad2-aef2-4a2b-8ae8-51ee9e41e049" status: 200 len: 1568 microversion: 2.1 time: 0.158289 Jul 18 10:37:29.443240 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 479/954] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:37:29 2022] GET /compute/v2.1/servers/00da9ad2-aef2-4a2b-8ae8-51ee9e41e049 => generated 1568 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:37:30.460984 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-e2301c43-3d39-4bae-9b57-14f8b3fe0a22 tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:37:30.462227 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-e2301c43-3d39-4bae-9b57-14f8b3fe0a22 tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] [instance: 00da9ad2-aef2-4a2b-8ae8-51ee9e41e049] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:37:30.468786 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-e2301c43-3d39-4bae-9b57-14f8b3fe0a22 tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:37:30.469233 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-e2301c43-3d39-4bae-9b57-14f8b3fe0a22 tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:37:30.469990 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-e2301c43-3d39-4bae-9b57-14f8b3fe0a22 tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:37:30.470416 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-e2301c43-3d39-4bae-9b57-14f8b3fe0a22 tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:37:30.606123 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-e2301c43-3d39-4bae-9b57-14f8b3fe0a22 tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de7190c1ae524da280700ef2548a4a17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5628452a1ceb4af293ea96c187983fa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:37:30.618522 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-e2301c43-3d39-4bae-9b57-14f8b3fe0a22 tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] 10.222.0.33 "GET /compute/v2.1/servers/00da9ad2-aef2-4a2b-8ae8-51ee9e41e049" status: 200 len: 1568 microversion: 2.1 time: 0.159368 Jul 18 10:37:30.628440 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 476/955] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:37:30 2022] GET /compute/v2.1/servers/00da9ad2-aef2-4a2b-8ae8-51ee9e41e049 => generated 1568 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:37:31.635835 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-54ba514c-041a-4002-84bc-6be991b78519 tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:37:31.636438 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-54ba514c-041a-4002-84bc-6be991b78519 tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] [instance: 00da9ad2-aef2-4a2b-8ae8-51ee9e41e049] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:37:31.642864 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-54ba514c-041a-4002-84bc-6be991b78519 tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:37:31.643318 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-54ba514c-041a-4002-84bc-6be991b78519 tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:37:31.644077 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-54ba514c-041a-4002-84bc-6be991b78519 tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:37:31.644526 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-54ba514c-041a-4002-84bc-6be991b78519 tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:37:31.778205 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-54ba514c-041a-4002-84bc-6be991b78519 tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de7190c1ae524da280700ef2548a4a17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5628452a1ceb4af293ea96c187983fa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:37:31.785985 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-54ba514c-041a-4002-84bc-6be991b78519 tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] 10.222.0.33 "GET /compute/v2.1/servers/00da9ad2-aef2-4a2b-8ae8-51ee9e41e049" status: 200 len: 1568 microversion: 2.1 time: 0.154044 Jul 18 10:37:31.786563 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 480/956] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:37:31 2022] GET /compute/v2.1/servers/00da9ad2-aef2-4a2b-8ae8-51ee9e41e049 => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:37:32.804205 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-84e323ee-33cd-418d-baaa-b65c9ed86602 tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:37:32.804844 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-84e323ee-33cd-418d-baaa-b65c9ed86602 tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] [instance: 00da9ad2-aef2-4a2b-8ae8-51ee9e41e049] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:37:32.812933 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-84e323ee-33cd-418d-baaa-b65c9ed86602 tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:37:32.813402 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-84e323ee-33cd-418d-baaa-b65c9ed86602 tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:37:32.814223 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-84e323ee-33cd-418d-baaa-b65c9ed86602 tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:37:32.814665 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-84e323ee-33cd-418d-baaa-b65c9ed86602 tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:37:32.956809 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-84e323ee-33cd-418d-baaa-b65c9ed86602 tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de7190c1ae524da280700ef2548a4a17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5628452a1ceb4af293ea96c187983fa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:37:32.965848 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-84e323ee-33cd-418d-baaa-b65c9ed86602 tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] 10.222.0.33 "GET /compute/v2.1/servers/00da9ad2-aef2-4a2b-8ae8-51ee9e41e049" status: 200 len: 1568 microversion: 2.1 time: 0.165542 Jul 18 10:37:32.975603 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 477/957] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:37:32 2022] GET /compute/v2.1/servers/00da9ad2-aef2-4a2b-8ae8-51ee9e41e049 => generated 1568 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:37:33.982630 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-481091d8-fbe3-49af-b074-b43ff1a20957 tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:37:33.983302 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-481091d8-fbe3-49af-b074-b43ff1a20957 tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] [instance: 00da9ad2-aef2-4a2b-8ae8-51ee9e41e049] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:37:33.989608 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-481091d8-fbe3-49af-b074-b43ff1a20957 tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:37:33.990055 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-481091d8-fbe3-49af-b074-b43ff1a20957 tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:37:33.990811 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-481091d8-fbe3-49af-b074-b43ff1a20957 tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:37:33.991236 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-481091d8-fbe3-49af-b074-b43ff1a20957 tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:37:34.121987 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-481091d8-fbe3-49af-b074-b43ff1a20957 tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de7190c1ae524da280700ef2548a4a17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5628452a1ceb4af293ea96c187983fa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:37:34.130149 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-481091d8-fbe3-49af-b074-b43ff1a20957 tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] 10.222.0.33 "GET /compute/v2.1/servers/00da9ad2-aef2-4a2b-8ae8-51ee9e41e049" status: 200 len: 1568 microversion: 2.1 time: 0.151314 Jul 18 10:37:34.130811 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 481/958] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:37:33 2022] GET /compute/v2.1/servers/00da9ad2-aef2-4a2b-8ae8-51ee9e41e049 => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:37:35.147355 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-11b226e1-6be4-4327-bc96-6dfebe9495a5 tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:37:35.147967 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-11b226e1-6be4-4327-bc96-6dfebe9495a5 tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] [instance: 00da9ad2-aef2-4a2b-8ae8-51ee9e41e049] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:37:35.155194 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-11b226e1-6be4-4327-bc96-6dfebe9495a5 tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:37:35.155646 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-11b226e1-6be4-4327-bc96-6dfebe9495a5 tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:37:35.156422 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-11b226e1-6be4-4327-bc96-6dfebe9495a5 tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:37:35.156886 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-11b226e1-6be4-4327-bc96-6dfebe9495a5 tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:37:35.290745 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-11b226e1-6be4-4327-bc96-6dfebe9495a5 tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de7190c1ae524da280700ef2548a4a17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5628452a1ceb4af293ea96c187983fa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:37:35.298274 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-11b226e1-6be4-4327-bc96-6dfebe9495a5 tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] 10.222.0.33 "GET /compute/v2.1/servers/00da9ad2-aef2-4a2b-8ae8-51ee9e41e049" status: 200 len: 1568 microversion: 2.1 time: 0.154967 Jul 18 10:37:35.298837 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 478/959] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:37:35 2022] GET /compute/v2.1/servers/00da9ad2-aef2-4a2b-8ae8-51ee9e41e049 => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:37:36.315067 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-d8c06474-dfa9-4e19-a8e7-54fb5344cfdb tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:37:36.315699 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-d8c06474-dfa9-4e19-a8e7-54fb5344cfdb tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] [instance: 00da9ad2-aef2-4a2b-8ae8-51ee9e41e049] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:37:36.322114 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-d8c06474-dfa9-4e19-a8e7-54fb5344cfdb tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:37:36.322558 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-d8c06474-dfa9-4e19-a8e7-54fb5344cfdb tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:37:36.323307 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-d8c06474-dfa9-4e19-a8e7-54fb5344cfdb tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:37:36.323739 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-d8c06474-dfa9-4e19-a8e7-54fb5344cfdb tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:37:36.451392 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-d8c06474-dfa9-4e19-a8e7-54fb5344cfdb tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de7190c1ae524da280700ef2548a4a17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5628452a1ceb4af293ea96c187983fa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:37:36.458710 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-d8c06474-dfa9-4e19-a8e7-54fb5344cfdb tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] 10.222.0.33 "GET /compute/v2.1/servers/00da9ad2-aef2-4a2b-8ae8-51ee9e41e049" status: 200 len: 1568 microversion: 2.1 time: 0.147438 Jul 18 10:37:36.459274 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 482/960] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:37:36 2022] GET /compute/v2.1/servers/00da9ad2-aef2-4a2b-8ae8-51ee9e41e049 => generated 1568 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:37:37.476217 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-c47dc92f-26d6-49a7-9723-730fcf1be38e tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:37:37.476824 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-c47dc92f-26d6-49a7-9723-730fcf1be38e tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] [instance: 00da9ad2-aef2-4a2b-8ae8-51ee9e41e049] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:37:37.483411 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-c47dc92f-26d6-49a7-9723-730fcf1be38e tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:37:37.483862 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-c47dc92f-26d6-49a7-9723-730fcf1be38e tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:37:37.484648 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-c47dc92f-26d6-49a7-9723-730fcf1be38e tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:37:37.485083 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-c47dc92f-26d6-49a7-9723-730fcf1be38e tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:37:37.613338 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-c47dc92f-26d6-49a7-9723-730fcf1be38e tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de7190c1ae524da280700ef2548a4a17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5628452a1ceb4af293ea96c187983fa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:37:37.622637 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-c47dc92f-26d6-49a7-9723-730fcf1be38e tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] 10.222.0.33 "GET /compute/v2.1/servers/00da9ad2-aef2-4a2b-8ae8-51ee9e41e049" status: 200 len: 1568 microversion: 2.1 time: 0.150546 Jul 18 10:37:37.623211 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 479/961] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:37:37 2022] GET /compute/v2.1/servers/00da9ad2-aef2-4a2b-8ae8-51ee9e41e049 => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:37:38.639021 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-b8ccea62-0c3c-40fd-9300-1dc296bf134e tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:37:38.639617 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-b8ccea62-0c3c-40fd-9300-1dc296bf134e tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] [instance: 00da9ad2-aef2-4a2b-8ae8-51ee9e41e049] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:37:38.647426 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-b8ccea62-0c3c-40fd-9300-1dc296bf134e tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:37:38.648034 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-b8ccea62-0c3c-40fd-9300-1dc296bf134e tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:37:38.649378 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-b8ccea62-0c3c-40fd-9300-1dc296bf134e tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:37:38.649855 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-b8ccea62-0c3c-40fd-9300-1dc296bf134e tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:37:38.812463 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-b8ccea62-0c3c-40fd-9300-1dc296bf134e tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de7190c1ae524da280700ef2548a4a17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5628452a1ceb4af293ea96c187983fa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:37:38.819900 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-b8ccea62-0c3c-40fd-9300-1dc296bf134e tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] 10.222.0.33 "GET /compute/v2.1/servers/00da9ad2-aef2-4a2b-8ae8-51ee9e41e049" status: 200 len: 1568 microversion: 2.1 time: 0.184639 Jul 18 10:37:38.820983 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 483/962] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:37:38 2022] GET /compute/v2.1/servers/00da9ad2-aef2-4a2b-8ae8-51ee9e41e049 => generated 1568 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:37:39.838023 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-8286f1f6-4f73-428d-95ea-115ef8b48b17 tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:37:39.838629 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-8286f1f6-4f73-428d-95ea-115ef8b48b17 tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] [instance: 00da9ad2-aef2-4a2b-8ae8-51ee9e41e049] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:37:39.845069 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-8286f1f6-4f73-428d-95ea-115ef8b48b17 tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:37:39.845513 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-8286f1f6-4f73-428d-95ea-115ef8b48b17 tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:37:39.846266 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-8286f1f6-4f73-428d-95ea-115ef8b48b17 tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:37:39.846695 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-8286f1f6-4f73-428d-95ea-115ef8b48b17 tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:37:39.985131 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-8286f1f6-4f73-428d-95ea-115ef8b48b17 tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de7190c1ae524da280700ef2548a4a17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5628452a1ceb4af293ea96c187983fa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:37:39.992971 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-8286f1f6-4f73-428d-95ea-115ef8b48b17 tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] 10.222.0.33 "GET /compute/v2.1/servers/00da9ad2-aef2-4a2b-8ae8-51ee9e41e049" status: 200 len: 1568 microversion: 2.1 time: 0.158806 Jul 18 10:37:39.993532 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 480/963] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:37:39 2022] GET /compute/v2.1/servers/00da9ad2-aef2-4a2b-8ae8-51ee9e41e049 => generated 1568 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:37:41.010822 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-843d3ff4-03bd-41eb-94d5-9b8f1a0e196b tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:37:41.011463 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-843d3ff4-03bd-41eb-94d5-9b8f1a0e196b tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] [instance: 00da9ad2-aef2-4a2b-8ae8-51ee9e41e049] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:37:41.017998 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-843d3ff4-03bd-41eb-94d5-9b8f1a0e196b tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:37:41.018453 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-843d3ff4-03bd-41eb-94d5-9b8f1a0e196b tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:37:41.019219 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-843d3ff4-03bd-41eb-94d5-9b8f1a0e196b tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:37:41.019658 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-843d3ff4-03bd-41eb-94d5-9b8f1a0e196b tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:37:41.151942 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-843d3ff4-03bd-41eb-94d5-9b8f1a0e196b tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de7190c1ae524da280700ef2548a4a17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5628452a1ceb4af293ea96c187983fa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:37:41.159600 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-843d3ff4-03bd-41eb-94d5-9b8f1a0e196b tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] 10.222.0.33 "GET /compute/v2.1/servers/00da9ad2-aef2-4a2b-8ae8-51ee9e41e049" status: 200 len: 1568 microversion: 2.1 time: 0.153315 Jul 18 10:37:41.160107 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 484/964] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:37:41 2022] GET /compute/v2.1/servers/00da9ad2-aef2-4a2b-8ae8-51ee9e41e049 => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:37:42.176999 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-63d28e1a-aa40-47b6-88ab-7f2c5adf9878 tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:37:42.177611 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-63d28e1a-aa40-47b6-88ab-7f2c5adf9878 tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] [instance: 00da9ad2-aef2-4a2b-8ae8-51ee9e41e049] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:37:42.184771 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-63d28e1a-aa40-47b6-88ab-7f2c5adf9878 tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:37:42.185223 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-63d28e1a-aa40-47b6-88ab-7f2c5adf9878 tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:37:42.185990 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-63d28e1a-aa40-47b6-88ab-7f2c5adf9878 tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:37:42.186425 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-63d28e1a-aa40-47b6-88ab-7f2c5adf9878 tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:37:42.325023 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-63d28e1a-aa40-47b6-88ab-7f2c5adf9878 tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de7190c1ae524da280700ef2548a4a17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5628452a1ceb4af293ea96c187983fa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:37:42.332454 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-63d28e1a-aa40-47b6-88ab-7f2c5adf9878 tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] 10.222.0.33 "GET /compute/v2.1/servers/00da9ad2-aef2-4a2b-8ae8-51ee9e41e049" status: 200 len: 1568 microversion: 2.1 time: 0.159315 Jul 18 10:37:42.333042 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 481/965] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:37:42 2022] GET /compute/v2.1/servers/00da9ad2-aef2-4a2b-8ae8-51ee9e41e049 => generated 1568 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:37:43.349926 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-fbdeac6e-0f4d-4be8-af83-f54d0ba2dfe3 tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:37:43.350542 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-fbdeac6e-0f4d-4be8-af83-f54d0ba2dfe3 tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] [instance: 00da9ad2-aef2-4a2b-8ae8-51ee9e41e049] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:37:43.357055 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-fbdeac6e-0f4d-4be8-af83-f54d0ba2dfe3 tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:37:43.357512 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-fbdeac6e-0f4d-4be8-af83-f54d0ba2dfe3 tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:37:43.358274 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-fbdeac6e-0f4d-4be8-af83-f54d0ba2dfe3 tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:37:43.358715 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-fbdeac6e-0f4d-4be8-af83-f54d0ba2dfe3 tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:37:43.491252 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-fbdeac6e-0f4d-4be8-af83-f54d0ba2dfe3 tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de7190c1ae524da280700ef2548a4a17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5628452a1ceb4af293ea96c187983fa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:37:43.498835 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-fbdeac6e-0f4d-4be8-af83-f54d0ba2dfe3 tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] 10.222.0.33 "GET /compute/v2.1/servers/00da9ad2-aef2-4a2b-8ae8-51ee9e41e049" status: 200 len: 1568 microversion: 2.1 time: 0.152712 Jul 18 10:37:43.499395 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 485/966] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:37:43 2022] GET /compute/v2.1/servers/00da9ad2-aef2-4a2b-8ae8-51ee9e41e049 => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:37:44.399327 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-444c6290-0e74-4148-bf0b-37e6e2cba439 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-456110652", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-986614198", "security_groups": [{"name": "tempest-secgroup-smoke-350612805"}], "block_device_mapping_v2": [{"uuid": "30fa3fc0-e2e0-42b3-b7e1-4ca9faed6dac", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "9e654fce-ea72-45f2-b759-da2c9a65544d"}]}} {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:37:44.516276 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-fcf37b49-49d6-40d4-aef3-b694687cb220 tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:37:44.517055 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-fcf37b49-49d6-40d4-aef3-b694687cb220 tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] [instance: 00da9ad2-aef2-4a2b-8ae8-51ee9e41e049] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:37:44.521447 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.network.neutron [None req-444c6290-0e74-4148-bf0b-37e6e2cba439 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] validate_networks() for [('9e654fce-ea72-45f2-b759-da2c9a65544d', None, None, None, None, None)] {{(pid=117880) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 10:37:44.530152 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-fcf37b49-49d6-40d4-aef3-b694687cb220 tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:37:44.530603 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-fcf37b49-49d6-40d4-aef3-b694687cb220 tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:37:44.531365 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-fcf37b49-49d6-40d4-aef3-b694687cb220 tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:37:44.531800 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-fcf37b49-49d6-40d4-aef3-b694687cb220 tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:37:45.017942 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-fcf37b49-49d6-40d4-aef3-b694687cb220 tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de7190c1ae524da280700ef2548a4a17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5628452a1ceb4af293ea96c187983fa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:37:45.026249 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-fcf37b49-49d6-40d4-aef3-b694687cb220 tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] 10.222.0.33 "GET /compute/v2.1/servers/00da9ad2-aef2-4a2b-8ae8-51ee9e41e049" status: 200 len: 1569 microversion: 2.1 time: 0.513903 Jul 18 10:37:45.026829 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 486/967] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:37:44 2022] GET /compute/v2.1/servers/00da9ad2-aef2-4a2b-8ae8-51ee9e41e049 => generated 1569 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:37:45.042546 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-c99f5d9f-f02c-4fff-ac1d-44e9fbbc7a51 tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:37:45.043112 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-c99f5d9f-f02c-4fff-ac1d-44e9fbbc7a51 tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] [instance: 00da9ad2-aef2-4a2b-8ae8-51ee9e41e049] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:37:45.049528 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-c99f5d9f-f02c-4fff-ac1d-44e9fbbc7a51 tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:37:45.049976 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-c99f5d9f-f02c-4fff-ac1d-44e9fbbc7a51 tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:37:45.050737 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-c99f5d9f-f02c-4fff-ac1d-44e9fbbc7a51 tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:37:45.051172 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-c99f5d9f-f02c-4fff-ac1d-44e9fbbc7a51 tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:37:45.148476 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-c99f5d9f-f02c-4fff-ac1d-44e9fbbc7a51 tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] 10.222.0.33 "POST /compute/v2.1/servers/00da9ad2-aef2-4a2b-8ae8-51ee9e41e049/action" status: 202 len: 0 microversion: 2.1 time: 0.109590 Jul 18 10:37:45.149232 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 487/968] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Jul 18 10:37:45 2022] POST /compute/v2.1/servers/00da9ad2-aef2-4a2b-8ae8-51ee9e41e049/action => generated 0 bytes in 111 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 18 10:37:45.157024 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-d3bcd518-15e7-44f8-a2b3-518f59a4a40e tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:37:45.157841 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-d3bcd518-15e7-44f8-a2b3-518f59a4a40e tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] [instance: 00da9ad2-aef2-4a2b-8ae8-51ee9e41e049] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:37:45.164687 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-d3bcd518-15e7-44f8-a2b3-518f59a4a40e tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:37:45.165148 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-d3bcd518-15e7-44f8-a2b3-518f59a4a40e tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:37:45.165936 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-d3bcd518-15e7-44f8-a2b3-518f59a4a40e tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:37:45.166592 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-d3bcd518-15e7-44f8-a2b3-518f59a4a40e tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:37:45.428562 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.virt.hardware [None req-444c6290-0e74-4148-bf0b-37e6e2cba439 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Flavor limits 0:0:0 {{(pid=117880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 10:37:45.429044 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.virt.hardware [None req-444c6290-0e74-4148-bf0b-37e6e2cba439 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Image limits 0:0:0 {{(pid=117880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 10:37:45.430083 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.virt.hardware [None req-444c6290-0e74-4148-bf0b-37e6e2cba439 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Flavor pref 0:0:0 {{(pid=117880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 10:37:45.430571 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.virt.hardware [None req-444c6290-0e74-4148-bf0b-37e6e2cba439 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Image pref 0:0:0 {{(pid=117880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 10:37:45.431049 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.virt.hardware [None req-444c6290-0e74-4148-bf0b-37e6e2cba439 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117880) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 10:37:45.440990 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-444c6290-0e74-4148-bf0b-37e6e2cba439 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:37:45.441444 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-444c6290-0e74-4148-bf0b-37e6e2cba439 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:37:45.442238 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-444c6290-0e74-4148-bf0b-37e6e2cba439 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:37:45.442904 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-444c6290-0e74-4148-bf0b-37e6e2cba439 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:37:45.443035 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-d3bcd518-15e7-44f8-a2b3-518f59a4a40e tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de7190c1ae524da280700ef2548a4a17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5628452a1ceb4af293ea96c187983fa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:37:45.451626 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-d3bcd518-15e7-44f8-a2b3-518f59a4a40e tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] 10.222.0.33 "GET /compute/v2.1/servers/00da9ad2-aef2-4a2b-8ae8-51ee9e41e049" status: 200 len: 1517 microversion: 2.1 time: 0.298273 Jul 18 10:37:45.452275 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 488/969] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:37:45 2022] GET /compute/v2.1/servers/00da9ad2-aef2-4a2b-8ae8-51ee9e41e049 => generated 1517 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:37:45.461355 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.quota [None req-444c6290-0e74-4148-bf0b-37e6e2cba439 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Getting quotas for project 2c656b71bbd447cba7d11335c928dfda. Resources: {'ram', 'cores', 'instances'} {{(pid=117880) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 10:37:45.465680 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.quota [None req-444c6290-0e74-4148-bf0b-37e6e2cba439 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Getting quotas for user 4e9eb8d188e040bca894e038955f2402 and project 2c656b71bbd447cba7d11335c928dfda. Resources: {'ram', 'cores', 'instances'} {{(pid=117880) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 10:37:45.524056 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-444c6290-0e74-4148-bf0b-37e6e2cba439 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Going to run 1 instances... {{(pid=117880) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 10:37:45.526318 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-444c6290-0e74-4148-bf0b-37e6e2cba439 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] [instance: 6e2ab0bb-d92f-4441-bdea-2bc427e441f8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='30fa3fc0-e2e0-42b3-b7e1-4ca9faed6dac',volume_size=None,volume_type=None)] {{(pid=117880) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 10:37:45.672566 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-444c6290-0e74-4148-bf0b-37e6e2cba439 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.279078 Jul 18 10:37:45.673766 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 482/970] 10.222.0.33 () {60 vars in 1146 bytes} [Mon Jul 18 10:37:44 2022] POST /compute/v2.1/servers => generated 405 bytes in 1281 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 10:37:45.683904 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-3bb09110-867c-45e1-9679-ebb304cc39ff tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:37:45.684670 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-3bb09110-867c-45e1-9679-ebb304cc39ff tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] [instance: 6e2ab0bb-d92f-4441-bdea-2bc427e441f8] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:37:45.758504 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-3bb09110-867c-45e1-9679-ebb304cc39ff tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9eb8d188e040bca894e038955f2402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c656b71bbd447cba7d11335c928dfda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:37:45.765669 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-3bb09110-867c-45e1-9679-ebb304cc39ff tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] 10.222.0.33 "GET /compute/v2.1/servers/6e2ab0bb-d92f-4441-bdea-2bc427e441f8" status: 200 len: 1093 microversion: 2.1 time: 0.086088 Jul 18 10:37:45.766292 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 489/971] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:37:45 2022] GET /compute/v2.1/servers/6e2ab0bb-d92f-4441-bdea-2bc427e441f8 => generated 1093 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:37:46.469224 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-1a6f324a-066b-4e3f-94c6-564658cde2fe tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:37:46.469780 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-1a6f324a-066b-4e3f-94c6-564658cde2fe tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] [instance: 00da9ad2-aef2-4a2b-8ae8-51ee9e41e049] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:37:46.476897 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-1a6f324a-066b-4e3f-94c6-564658cde2fe tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:37:46.477303 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-1a6f324a-066b-4e3f-94c6-564658cde2fe tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:37:46.478089 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-1a6f324a-066b-4e3f-94c6-564658cde2fe tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:37:46.478518 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-1a6f324a-066b-4e3f-94c6-564658cde2fe tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:37:46.615402 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-1a6f324a-066b-4e3f-94c6-564658cde2fe tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de7190c1ae524da280700ef2548a4a17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5628452a1ceb4af293ea96c187983fa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:37:46.624172 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-1a6f324a-066b-4e3f-94c6-564658cde2fe tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] 10.222.0.33 "GET /compute/v2.1/servers/00da9ad2-aef2-4a2b-8ae8-51ee9e41e049" status: 200 len: 1519 microversion: 2.1 time: 0.158646 Jul 18 10:37:46.624783 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 483/972] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:37:46 2022] GET /compute/v2.1/servers/00da9ad2-aef2-4a2b-8ae8-51ee9e41e049 => generated 1519 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:37:46.782810 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-3071a8bd-3c97-42b9-a02b-840bbec4b651 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:37:46.783545 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-3071a8bd-3c97-42b9-a02b-840bbec4b651 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] [instance: 6e2ab0bb-d92f-4441-bdea-2bc427e441f8] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:37:46.790658 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-3071a8bd-3c97-42b9-a02b-840bbec4b651 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:37:46.791107 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-3071a8bd-3c97-42b9-a02b-840bbec4b651 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:37:46.791872 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-3071a8bd-3c97-42b9-a02b-840bbec4b651 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:37:46.792305 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-3071a8bd-3c97-42b9-a02b-840bbec4b651 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:37:46.853101 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-3071a8bd-3c97-42b9-a02b-840bbec4b651 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9eb8d188e040bca894e038955f2402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c656b71bbd447cba7d11335c928dfda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:37:46.860544 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-3071a8bd-3c97-42b9-a02b-840bbec4b651 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] 10.222.0.33 "GET /compute/v2.1/servers/6e2ab0bb-d92f-4441-bdea-2bc427e441f8" status: 200 len: 1209 microversion: 2.1 time: 0.081931 Jul 18 10:37:46.861244 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 490/973] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:37:46 2022] GET /compute/v2.1/servers/6e2ab0bb-d92f-4441-bdea-2bc427e441f8 => generated 1209 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:37:47.643188 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-4a69a85c-6da1-40e3-a69c-3f49f5567075 tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:37:47.643841 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-4a69a85c-6da1-40e3-a69c-3f49f5567075 tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] [instance: 00da9ad2-aef2-4a2b-8ae8-51ee9e41e049] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:37:47.650700 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-4a69a85c-6da1-40e3-a69c-3f49f5567075 tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:37:47.651151 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-4a69a85c-6da1-40e3-a69c-3f49f5567075 tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:37:47.651919 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-4a69a85c-6da1-40e3-a69c-3f49f5567075 tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:37:47.652351 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-4a69a85c-6da1-40e3-a69c-3f49f5567075 tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:37:47.878376 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-007aba32-f7ff-407a-9e77-d21a67072361 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:37:47.879078 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-007aba32-f7ff-407a-9e77-d21a67072361 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] [instance: 6e2ab0bb-d92f-4441-bdea-2bc427e441f8] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:37:47.886048 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-007aba32-f7ff-407a-9e77-d21a67072361 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:37:47.886504 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-007aba32-f7ff-407a-9e77-d21a67072361 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:37:47.887279 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-007aba32-f7ff-407a-9e77-d21a67072361 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:37:47.887716 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-007aba32-f7ff-407a-9e77-d21a67072361 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:37:47.909440 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-4a69a85c-6da1-40e3-a69c-3f49f5567075 tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de7190c1ae524da280700ef2548a4a17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5628452a1ceb4af293ea96c187983fa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:37:47.917703 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-4a69a85c-6da1-40e3-a69c-3f49f5567075 tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] 10.222.0.33 "GET /compute/v2.1/servers/00da9ad2-aef2-4a2b-8ae8-51ee9e41e049" status: 200 len: 1575 microversion: 2.1 time: 0.278322 Jul 18 10:37:47.918404 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 484/974] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:37:47 2022] GET /compute/v2.1/servers/00da9ad2-aef2-4a2b-8ae8-51ee9e41e049 => generated 1575 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:37:48.173733 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-007aba32-f7ff-407a-9e77-d21a67072361 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9eb8d188e040bca894e038955f2402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c656b71bbd447cba7d11335c928dfda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:37:48.185163 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-007aba32-f7ff-407a-9e77-d21a67072361 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] 10.222.0.33 "GET /compute/v2.1/servers/6e2ab0bb-d92f-4441-bdea-2bc427e441f8" status: 200 len: 1264 microversion: 2.1 time: 0.310377 Jul 18 10:37:48.186142 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 491/975] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:37:47 2022] GET /compute/v2.1/servers/6e2ab0bb-d92f-4441-bdea-2bc427e441f8 => generated 1264 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:37:48.504596 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [req-2c58a308-f6f6-409a-b90f-148b6f675ad2 req-91ae8161-f9c2-479d-9fdd-d6bb09baecdd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "00da9ad2-aef2-4a2b-8ae8-51ee9e41e049", "name": "network-vif-unplugged", "status": "completed", "tag": "01aa80e4-4901-4d77-80cb-a644fd1ee6ff"}]} {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:37:48.514076 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [req-2c58a308-f6f6-409a-b90f-148b6f675ad2 req-91ae8161-f9c2-479d-9fdd-d6bb09baecdd service nova] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:37:48.514528 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [req-2c58a308-f6f6-409a-b90f-148b6f675ad2 req-91ae8161-f9c2-479d-9fdd-d6bb09baecdd service nova] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:37:48.527035 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.compute.server_external_events [req-2c58a308-f6f6-409a-b90f-148b6f675ad2 req-91ae8161-f9c2-479d-9fdd-d6bb09baecdd service nova] Creating event network-vif-unplugged:01aa80e4-4901-4d77-80cb-a644fd1ee6ff for instance 00da9ad2-aef2-4a2b-8ae8-51ee9e41e049 on hv-cinder-83754 Jul 18 10:37:48.532495 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [req-2c58a308-f6f6-409a-b90f-148b6f675ad2 req-91ae8161-f9c2-479d-9fdd-d6bb09baecdd service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032314 Jul 18 10:37:48.533532 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 485/976] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jul 18 10:37:48 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:37:48.936550 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-e08e48bd-c2e2-401f-9958-82752e4e9de8 tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:37:48.937365 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-e08e48bd-c2e2-401f-9958-82752e4e9de8 tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] [instance: 00da9ad2-aef2-4a2b-8ae8-51ee9e41e049] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:37:48.944466 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-e08e48bd-c2e2-401f-9958-82752e4e9de8 tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:37:48.945031 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-e08e48bd-c2e2-401f-9958-82752e4e9de8 tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:37:48.946056 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-e08e48bd-c2e2-401f-9958-82752e4e9de8 tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:37:48.946560 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-e08e48bd-c2e2-401f-9958-82752e4e9de8 tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:37:49.149201 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [req-17612c9d-3d2a-4dd8-b851-21433b3ba2aa req-82930e04-ff26-448d-bec5-7949816ff38d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6e2ab0bb-d92f-4441-bdea-2bc427e441f8", "tag": "9c584805-1812-494e-8d2b-019452f06e9c"}]} {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:37:49.164350 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [req-17612c9d-3d2a-4dd8-b851-21433b3ba2aa req-82930e04-ff26-448d-bec5-7949816ff38d service nova] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:37:49.165384 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [req-17612c9d-3d2a-4dd8-b851-21433b3ba2aa req-82930e04-ff26-448d-bec5-7949816ff38d service nova] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:37:49.180174 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.compute.server_external_events [req-17612c9d-3d2a-4dd8-b851-21433b3ba2aa req-82930e04-ff26-448d-bec5-7949816ff38d service nova] Creating event network-changed:9c584805-1812-494e-8d2b-019452f06e9c for instance 6e2ab0bb-d92f-4441-bdea-2bc427e441f8 on hv-cinder-83754 Jul 18 10:37:49.185948 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-e08e48bd-c2e2-401f-9958-82752e4e9de8 tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de7190c1ae524da280700ef2548a4a17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5628452a1ceb4af293ea96c187983fa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:37:49.189233 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [req-17612c9d-3d2a-4dd8-b851-21433b3ba2aa req-82930e04-ff26-448d-bec5-7949816ff38d service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044986 Jul 18 10:37:49.190145 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 486/977] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jul 18 10:37:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:37:49.192185 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG dbcounter [-] [117879] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:37:49.201492 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-e08e48bd-c2e2-401f-9958-82752e4e9de8 tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] 10.222.0.33 "GET /compute/v2.1/servers/00da9ad2-aef2-4a2b-8ae8-51ee9e41e049" status: 200 len: 1575 microversion: 2.1 time: 0.269118 Jul 18 10:37:49.202442 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 492/978] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:37:48 2022] GET /compute/v2.1/servers/00da9ad2-aef2-4a2b-8ae8-51ee9e41e049 => generated 1575 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:37:49.212479 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-76b77896-7fe2-4067-ac91-0add3197a0d0 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:37:49.213812 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-76b77896-7fe2-4067-ac91-0add3197a0d0 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] [instance: 6e2ab0bb-d92f-4441-bdea-2bc427e441f8] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:37:49.220619 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-76b77896-7fe2-4067-ac91-0add3197a0d0 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:37:49.221321 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-76b77896-7fe2-4067-ac91-0add3197a0d0 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:37:49.222429 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-76b77896-7fe2-4067-ac91-0add3197a0d0 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:37:49.222881 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-76b77896-7fe2-4067-ac91-0add3197a0d0 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:37:49.440107 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-76b77896-7fe2-4067-ac91-0add3197a0d0 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9eb8d188e040bca894e038955f2402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c656b71bbd447cba7d11335c928dfda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:37:49.449060 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-76b77896-7fe2-4067-ac91-0add3197a0d0 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] 10.222.0.33 "GET /compute/v2.1/servers/6e2ab0bb-d92f-4441-bdea-2bc427e441f8" status: 200 len: 1264 microversion: 2.1 time: 0.248635 Jul 18 10:37:49.449626 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 487/979] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:37:49 2022] GET /compute/v2.1/servers/6e2ab0bb-d92f-4441-bdea-2bc427e441f8 => generated 1264 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:37:50.218346 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-caf4a41d-8b5a-4c98-928a-8e583cc0ed7b tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:37:50.218947 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-caf4a41d-8b5a-4c98-928a-8e583cc0ed7b tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] [instance: 00da9ad2-aef2-4a2b-8ae8-51ee9e41e049] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:37:50.227085 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-caf4a41d-8b5a-4c98-928a-8e583cc0ed7b tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:37:50.227539 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-caf4a41d-8b5a-4c98-928a-8e583cc0ed7b tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:37:50.228296 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-caf4a41d-8b5a-4c98-928a-8e583cc0ed7b tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:37:50.228757 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-caf4a41d-8b5a-4c98-928a-8e583cc0ed7b tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:37:50.440282 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-caf4a41d-8b5a-4c98-928a-8e583cc0ed7b tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de7190c1ae524da280700ef2548a4a17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5628452a1ceb4af293ea96c187983fa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:37:50.450168 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-caf4a41d-8b5a-4c98-928a-8e583cc0ed7b tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] 10.222.0.33 "GET /compute/v2.1/servers/00da9ad2-aef2-4a2b-8ae8-51ee9e41e049" status: 200 len: 1575 microversion: 2.1 time: 0.235857 Jul 18 10:37:50.450755 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 493/980] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:37:50 2022] GET /compute/v2.1/servers/00da9ad2-aef2-4a2b-8ae8-51ee9e41e049 => generated 1575 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:37:50.466096 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-a5fac352-e5e5-4224-9837-6ee1b2f3abe5 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:37:50.466708 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-a5fac352-e5e5-4224-9837-6ee1b2f3abe5 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] [instance: 6e2ab0bb-d92f-4441-bdea-2bc427e441f8] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:37:50.473197 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-a5fac352-e5e5-4224-9837-6ee1b2f3abe5 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:37:50.473647 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-a5fac352-e5e5-4224-9837-6ee1b2f3abe5 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:37:50.474410 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-a5fac352-e5e5-4224-9837-6ee1b2f3abe5 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:37:50.474842 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-a5fac352-e5e5-4224-9837-6ee1b2f3abe5 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:37:50.683149 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-a5fac352-e5e5-4224-9837-6ee1b2f3abe5 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9eb8d188e040bca894e038955f2402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c656b71bbd447cba7d11335c928dfda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:37:50.691058 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-a5fac352-e5e5-4224-9837-6ee1b2f3abe5 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] 10.222.0.33 "GET /compute/v2.1/servers/6e2ab0bb-d92f-4441-bdea-2bc427e441f8" status: 200 len: 1264 microversion: 2.1 time: 0.228727 Jul 18 10:37:50.691792 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 488/981] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:37:50 2022] GET /compute/v2.1/servers/6e2ab0bb-d92f-4441-bdea-2bc427e441f8 => generated 1264 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:37:51.467514 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-707e05b7-6899-4f2b-9e8a-dc08957fb02f tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:37:51.468097 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-707e05b7-6899-4f2b-9e8a-dc08957fb02f tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] [instance: 00da9ad2-aef2-4a2b-8ae8-51ee9e41e049] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:37:51.474700 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-707e05b7-6899-4f2b-9e8a-dc08957fb02f tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:37:51.475151 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-707e05b7-6899-4f2b-9e8a-dc08957fb02f tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:37:51.476187 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-707e05b7-6899-4f2b-9e8a-dc08957fb02f tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:37:51.476656 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-707e05b7-6899-4f2b-9e8a-dc08957fb02f tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:37:51.615345 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-707e05b7-6899-4f2b-9e8a-dc08957fb02f tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de7190c1ae524da280700ef2548a4a17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5628452a1ceb4af293ea96c187983fa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:37:51.622864 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-707e05b7-6899-4f2b-9e8a-dc08957fb02f tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] 10.222.0.33 "GET /compute/v2.1/servers/00da9ad2-aef2-4a2b-8ae8-51ee9e41e049" status: 200 len: 1575 microversion: 2.1 time: 0.159328 Jul 18 10:37:51.623440 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 494/982] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:37:51 2022] GET /compute/v2.1/servers/00da9ad2-aef2-4a2b-8ae8-51ee9e41e049 => generated 1575 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:37:51.707845 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-c1d0c5d6-3765-40d8-8850-1cdb375892ef tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:37:51.708451 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-c1d0c5d6-3765-40d8-8850-1cdb375892ef tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] [instance: 6e2ab0bb-d92f-4441-bdea-2bc427e441f8] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:37:51.715494 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-c1d0c5d6-3765-40d8-8850-1cdb375892ef tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:37:51.715944 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-c1d0c5d6-3765-40d8-8850-1cdb375892ef tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:37:51.716729 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-c1d0c5d6-3765-40d8-8850-1cdb375892ef tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:37:51.717166 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-c1d0c5d6-3765-40d8-8850-1cdb375892ef tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:37:51.858992 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-c1d0c5d6-3765-40d8-8850-1cdb375892ef tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9eb8d188e040bca894e038955f2402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c656b71bbd447cba7d11335c928dfda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:37:51.866593 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-c1d0c5d6-3765-40d8-8850-1cdb375892ef tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] 10.222.0.33 "GET /compute/v2.1/servers/6e2ab0bb-d92f-4441-bdea-2bc427e441f8" status: 200 len: 1264 microversion: 2.1 time: 0.162624 Jul 18 10:37:51.876117 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 489/983] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:37:51 2022] GET /compute/v2.1/servers/6e2ab0bb-d92f-4441-bdea-2bc427e441f8 => generated 1264 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:37:52.639735 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-94c0d182-d13e-4325-927a-c56be7b7b664 tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:37:52.640883 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-94c0d182-d13e-4325-927a-c56be7b7b664 tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] [instance: 00da9ad2-aef2-4a2b-8ae8-51ee9e41e049] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:37:52.647682 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-94c0d182-d13e-4325-927a-c56be7b7b664 tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:37:52.648143 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-94c0d182-d13e-4325-927a-c56be7b7b664 tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:37:52.648951 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-94c0d182-d13e-4325-927a-c56be7b7b664 tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:37:52.649392 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-94c0d182-d13e-4325-927a-c56be7b7b664 tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:37:52.783118 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-94c0d182-d13e-4325-927a-c56be7b7b664 tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de7190c1ae524da280700ef2548a4a17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5628452a1ceb4af293ea96c187983fa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:37:52.790915 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-94c0d182-d13e-4325-927a-c56be7b7b664 tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] 10.222.0.33 "GET /compute/v2.1/servers/00da9ad2-aef2-4a2b-8ae8-51ee9e41e049" status: 200 len: 1575 microversion: 2.1 time: 0.155026 Jul 18 10:37:52.791485 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 495/984] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:37:52 2022] GET /compute/v2.1/servers/00da9ad2-aef2-4a2b-8ae8-51ee9e41e049 => generated 1575 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:37:52.884426 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-4e9f6f69-afe2-43ad-b6de-00cf22c0a7c0 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:37:52.885091 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-4e9f6f69-afe2-43ad-b6de-00cf22c0a7c0 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] [instance: 6e2ab0bb-d92f-4441-bdea-2bc427e441f8] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:37:52.891607 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-4e9f6f69-afe2-43ad-b6de-00cf22c0a7c0 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:37:52.891999 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-4e9f6f69-afe2-43ad-b6de-00cf22c0a7c0 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:37:52.892800 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-4e9f6f69-afe2-43ad-b6de-00cf22c0a7c0 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:37:52.893236 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-4e9f6f69-afe2-43ad-b6de-00cf22c0a7c0 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:37:53.025187 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-4e9f6f69-afe2-43ad-b6de-00cf22c0a7c0 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9eb8d188e040bca894e038955f2402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c656b71bbd447cba7d11335c928dfda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:37:53.033757 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-4e9f6f69-afe2-43ad-b6de-00cf22c0a7c0 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] 10.222.0.33 "GET /compute/v2.1/servers/6e2ab0bb-d92f-4441-bdea-2bc427e441f8" status: 200 len: 1264 microversion: 2.1 time: 0.153749 Jul 18 10:37:53.034334 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 490/985] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:37:52 2022] GET /compute/v2.1/servers/6e2ab0bb-d92f-4441-bdea-2bc427e441f8 => generated 1264 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:37:53.807350 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-74121d4c-ec50-45ef-aeb8-d6a04a687ec8 tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:37:53.807993 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-74121d4c-ec50-45ef-aeb8-d6a04a687ec8 tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] [instance: 00da9ad2-aef2-4a2b-8ae8-51ee9e41e049] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:37:53.814436 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-74121d4c-ec50-45ef-aeb8-d6a04a687ec8 tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:37:53.814891 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-74121d4c-ec50-45ef-aeb8-d6a04a687ec8 tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:37:53.815659 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-74121d4c-ec50-45ef-aeb8-d6a04a687ec8 tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:37:53.816102 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-74121d4c-ec50-45ef-aeb8-d6a04a687ec8 tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:37:53.951130 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-74121d4c-ec50-45ef-aeb8-d6a04a687ec8 tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de7190c1ae524da280700ef2548a4a17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5628452a1ceb4af293ea96c187983fa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:37:53.958467 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-74121d4c-ec50-45ef-aeb8-d6a04a687ec8 tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] 10.222.0.33 "GET /compute/v2.1/servers/00da9ad2-aef2-4a2b-8ae8-51ee9e41e049" status: 200 len: 1575 microversion: 2.1 time: 0.155186 Jul 18 10:37:53.959015 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 496/986] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:37:53 2022] GET /compute/v2.1/servers/00da9ad2-aef2-4a2b-8ae8-51ee9e41e049 => generated 1575 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:37:54.051669 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-c75dfeb0-b9f0-451f-8078-fc811e806127 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:37:54.052282 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-c75dfeb0-b9f0-451f-8078-fc811e806127 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] [instance: 6e2ab0bb-d92f-4441-bdea-2bc427e441f8] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:37:54.059776 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-c75dfeb0-b9f0-451f-8078-fc811e806127 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:37:54.060232 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-c75dfeb0-b9f0-451f-8078-fc811e806127 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:37:54.061059 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-c75dfeb0-b9f0-451f-8078-fc811e806127 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:37:54.061494 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-c75dfeb0-b9f0-451f-8078-fc811e806127 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:37:54.200113 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-c75dfeb0-b9f0-451f-8078-fc811e806127 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9eb8d188e040bca894e038955f2402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c656b71bbd447cba7d11335c928dfda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:37:54.208279 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-c75dfeb0-b9f0-451f-8078-fc811e806127 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] 10.222.0.33 "GET /compute/v2.1/servers/6e2ab0bb-d92f-4441-bdea-2bc427e441f8" status: 200 len: 1264 microversion: 2.1 time: 0.161036 Jul 18 10:37:54.209135 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 491/987] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:37:54 2022] GET /compute/v2.1/servers/6e2ab0bb-d92f-4441-bdea-2bc427e441f8 => generated 1264 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:37:54.976675 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-52352830-5f63-4f61-b6e2-7580fb33ebf5 tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:37:54.977313 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-52352830-5f63-4f61-b6e2-7580fb33ebf5 tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] [instance: 00da9ad2-aef2-4a2b-8ae8-51ee9e41e049] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:37:54.983861 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-52352830-5f63-4f61-b6e2-7580fb33ebf5 tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:37:54.984341 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-52352830-5f63-4f61-b6e2-7580fb33ebf5 tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:37:54.985144 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-52352830-5f63-4f61-b6e2-7580fb33ebf5 tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:37:54.985590 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-52352830-5f63-4f61-b6e2-7580fb33ebf5 tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:37:55.124392 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-52352830-5f63-4f61-b6e2-7580fb33ebf5 tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de7190c1ae524da280700ef2548a4a17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5628452a1ceb4af293ea96c187983fa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:37:55.131871 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-52352830-5f63-4f61-b6e2-7580fb33ebf5 tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] 10.222.0.33 "GET /compute/v2.1/servers/00da9ad2-aef2-4a2b-8ae8-51ee9e41e049" status: 200 len: 1575 microversion: 2.1 time: 0.159834 Jul 18 10:37:55.132430 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 497/988] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:37:54 2022] GET /compute/v2.1/servers/00da9ad2-aef2-4a2b-8ae8-51ee9e41e049 => generated 1575 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:37:55.225547 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-958f599c-92eb-454f-ab63-78e074c73b10 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:37:55.226422 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-958f599c-92eb-454f-ab63-78e074c73b10 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] [instance: 6e2ab0bb-d92f-4441-bdea-2bc427e441f8] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:37:55.233435 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-958f599c-92eb-454f-ab63-78e074c73b10 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:37:55.233885 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-958f599c-92eb-454f-ab63-78e074c73b10 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:37:55.234640 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-958f599c-92eb-454f-ab63-78e074c73b10 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:37:55.235080 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-958f599c-92eb-454f-ab63-78e074c73b10 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:37:55.369158 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-958f599c-92eb-454f-ab63-78e074c73b10 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9eb8d188e040bca894e038955f2402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c656b71bbd447cba7d11335c928dfda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:37:55.376754 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-958f599c-92eb-454f-ab63-78e074c73b10 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] 10.222.0.33 "GET /compute/v2.1/servers/6e2ab0bb-d92f-4441-bdea-2bc427e441f8" status: 200 len: 1264 microversion: 2.1 time: 0.154978 Jul 18 10:37:55.377322 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 492/989] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:37:55 2022] GET /compute/v2.1/servers/6e2ab0bb-d92f-4441-bdea-2bc427e441f8 => generated 1264 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:37:56.149315 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-4f113767-5482-4c7a-9969-c9deb3e78163 tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:37:56.149927 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-4f113767-5482-4c7a-9969-c9deb3e78163 tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] [instance: 00da9ad2-aef2-4a2b-8ae8-51ee9e41e049] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:37:56.151799 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG dbcounter [-] [117879] Writing DB stats nova_cell0:SELECT=2 {{(pid=117879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:37:56.158439 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-4f113767-5482-4c7a-9969-c9deb3e78163 tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:37:56.158589 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-4f113767-5482-4c7a-9969-c9deb3e78163 tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:37:56.159248 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-4f113767-5482-4c7a-9969-c9deb3e78163 tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:37:56.159687 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-4f113767-5482-4c7a-9969-c9deb3e78163 tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:37:56.292609 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-4f113767-5482-4c7a-9969-c9deb3e78163 tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de7190c1ae524da280700ef2548a4a17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5628452a1ceb4af293ea96c187983fa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:37:56.300034 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-4f113767-5482-4c7a-9969-c9deb3e78163 tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] 10.222.0.33 "GET /compute/v2.1/servers/00da9ad2-aef2-4a2b-8ae8-51ee9e41e049" status: 200 len: 1575 microversion: 2.1 time: 0.154574 Jul 18 10:37:56.300620 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 498/990] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:37:56 2022] GET /compute/v2.1/servers/00da9ad2-aef2-4a2b-8ae8-51ee9e41e049 => generated 1575 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:37:56.393358 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-6e137f70-fc07-440d-89bf-d686f34dc1b6 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:37:56.394028 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-6e137f70-fc07-440d-89bf-d686f34dc1b6 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] [instance: 6e2ab0bb-d92f-4441-bdea-2bc427e441f8] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:37:56.395928 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG dbcounter [-] [117880] Writing DB stats nova_cell0:SELECT=2 {{(pid=117880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:37:56.396603 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG dbcounter [-] [117880] Writing DB stats nova_cell0:SELECT=6 {{(pid=117880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:37:56.403426 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-6e137f70-fc07-440d-89bf-d686f34dc1b6 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:37:56.403875 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-6e137f70-fc07-440d-89bf-d686f34dc1b6 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:37:56.404674 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-6e137f70-fc07-440d-89bf-d686f34dc1b6 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:37:56.405108 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-6e137f70-fc07-440d-89bf-d686f34dc1b6 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:37:56.543592 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-6e137f70-fc07-440d-89bf-d686f34dc1b6 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9eb8d188e040bca894e038955f2402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c656b71bbd447cba7d11335c928dfda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:37:56.549190 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG dbcounter [-] [117880] Writing DB stats nova_cell1:SELECT=100 {{(pid=117880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:37:56.554607 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-6e137f70-fc07-440d-89bf-d686f34dc1b6 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] 10.222.0.33 "GET /compute/v2.1/servers/6e2ab0bb-d92f-4441-bdea-2bc427e441f8" status: 200 len: 1264 microversion: 2.1 time: 0.164966 Jul 18 10:37:56.564682 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 493/991] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:37:56 2022] GET /compute/v2.1/servers/6e2ab0bb-d92f-4441-bdea-2bc427e441f8 => generated 1264 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:37:57.317475 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-db411eb7-c04c-44ee-b65c-3b495b97e333 tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:37:57.318083 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-db411eb7-c04c-44ee-b65c-3b495b97e333 tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] [instance: 00da9ad2-aef2-4a2b-8ae8-51ee9e41e049] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:37:57.325182 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-db411eb7-c04c-44ee-b65c-3b495b97e333 tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:37:57.325634 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-db411eb7-c04c-44ee-b65c-3b495b97e333 tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:37:57.326395 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-db411eb7-c04c-44ee-b65c-3b495b97e333 tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:37:57.326830 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-db411eb7-c04c-44ee-b65c-3b495b97e333 tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:37:57.468146 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-db411eb7-c04c-44ee-b65c-3b495b97e333 tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de7190c1ae524da280700ef2548a4a17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5628452a1ceb4af293ea96c187983fa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:37:57.475973 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-db411eb7-c04c-44ee-b65c-3b495b97e333 tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] 10.222.0.33 "GET /compute/v2.1/servers/00da9ad2-aef2-4a2b-8ae8-51ee9e41e049" status: 200 len: 1562 microversion: 2.1 time: 0.162078 Jul 18 10:37:57.476554 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 499/992] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:37:57 2022] GET /compute/v2.1/servers/00da9ad2-aef2-4a2b-8ae8-51ee9e41e049 => generated 1562 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:37:57.571445 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-2a302f76-3ecb-476a-87f2-59584acf142a tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:37:57.572053 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-2a302f76-3ecb-476a-87f2-59584acf142a tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] [instance: 6e2ab0bb-d92f-4441-bdea-2bc427e441f8] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:37:57.579164 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-2a302f76-3ecb-476a-87f2-59584acf142a tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:37:57.579648 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-2a302f76-3ecb-476a-87f2-59584acf142a tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:37:57.580374 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-2a302f76-3ecb-476a-87f2-59584acf142a tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:37:57.580834 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-2a302f76-3ecb-476a-87f2-59584acf142a tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:37:57.719902 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-2a302f76-3ecb-476a-87f2-59584acf142a tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9eb8d188e040bca894e038955f2402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c656b71bbd447cba7d11335c928dfda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:37:57.727756 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-2a302f76-3ecb-476a-87f2-59584acf142a tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] 10.222.0.33 "GET /compute/v2.1/servers/6e2ab0bb-d92f-4441-bdea-2bc427e441f8" status: 200 len: 1264 microversion: 2.1 time: 0.160420 Jul 18 10:37:57.728322 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 494/993] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:37:57 2022] GET /compute/v2.1/servers/6e2ab0bb-d92f-4441-bdea-2bc427e441f8 => generated 1264 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:37:58.745714 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-62b7baa9-2be1-419b-b49f-41ccbaf46410 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:37:58.746295 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-62b7baa9-2be1-419b-b49f-41ccbaf46410 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] [instance: 6e2ab0bb-d92f-4441-bdea-2bc427e441f8] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:37:58.750797 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [req-a711189c-7890-4bcc-bdfc-e82cd92a28fd req-3bf0abcd-8de0-40a3-b3b4-b3c48a351cc5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "00da9ad2-aef2-4a2b-8ae8-51ee9e41e049", "name": "network-vif-plugged", "status": "completed", "tag": "01aa80e4-4901-4d77-80cb-a644fd1ee6ff"}]} {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:37:58.752101 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG dbcounter [-] [117879] Writing DB stats nova_api:SELECT=48 {{(pid=117879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:37:58.753656 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-62b7baa9-2be1-419b-b49f-41ccbaf46410 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:37:58.754102 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-62b7baa9-2be1-419b-b49f-41ccbaf46410 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:37:58.755085 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-62b7baa9-2be1-419b-b49f-41ccbaf46410 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:37:58.755684 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-62b7baa9-2be1-419b-b49f-41ccbaf46410 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:37:58.756089 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG dbcounter [-] [117880] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=3 {{(pid=117880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:37:58.761703 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [req-a711189c-7890-4bcc-bdfc-e82cd92a28fd req-3bf0abcd-8de0-40a3-b3b4-b3c48a351cc5 service nova] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:37:58.762541 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [req-a711189c-7890-4bcc-bdfc-e82cd92a28fd req-3bf0abcd-8de0-40a3-b3b4-b3c48a351cc5 service nova] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:37:58.776347 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.compute.server_external_events [req-a711189c-7890-4bcc-bdfc-e82cd92a28fd req-3bf0abcd-8de0-40a3-b3b4-b3c48a351cc5 service nova] Creating event network-vif-plugged:01aa80e4-4901-4d77-80cb-a644fd1ee6ff for instance 00da9ad2-aef2-4a2b-8ae8-51ee9e41e049 on hv-cinder-83754 Jul 18 10:37:58.783773 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [req-a711189c-7890-4bcc-bdfc-e82cd92a28fd req-3bf0abcd-8de0-40a3-b3b4-b3c48a351cc5 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036691 Jul 18 10:37:58.784862 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 495/994] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jul 18 10:37:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:37:59.046545 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-62b7baa9-2be1-419b-b49f-41ccbaf46410 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9eb8d188e040bca894e038955f2402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c656b71bbd447cba7d11335c928dfda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:37:59.054504 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-62b7baa9-2be1-419b-b49f-41ccbaf46410 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] 10.222.0.33 "GET /compute/v2.1/servers/6e2ab0bb-d92f-4441-bdea-2bc427e441f8" status: 200 len: 1264 microversion: 2.1 time: 0.313220 Jul 18 10:37:59.055075 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 500/995] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:37:58 2022] GET /compute/v2.1/servers/6e2ab0bb-d92f-4441-bdea-2bc427e441f8 => generated 1264 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:38:00.072494 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-63bf989a-53e2-4785-bdea-04b762161de0 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:38:00.073853 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-63bf989a-53e2-4785-bdea-04b762161de0 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] [instance: 6e2ab0bb-d92f-4441-bdea-2bc427e441f8] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:38:00.080152 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-63bf989a-53e2-4785-bdea-04b762161de0 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:38:00.080622 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-63bf989a-53e2-4785-bdea-04b762161de0 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:38:00.081381 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-63bf989a-53e2-4785-bdea-04b762161de0 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:38:00.081838 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-63bf989a-53e2-4785-bdea-04b762161de0 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:38:00.211676 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-63bf989a-53e2-4785-bdea-04b762161de0 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9eb8d188e040bca894e038955f2402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c656b71bbd447cba7d11335c928dfda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:38:00.219076 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-63bf989a-53e2-4785-bdea-04b762161de0 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] 10.222.0.33 "GET /compute/v2.1/servers/6e2ab0bb-d92f-4441-bdea-2bc427e441f8" status: 200 len: 1264 microversion: 2.1 time: 0.151614 Jul 18 10:38:00.219635 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 496/996] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:38:00 2022] GET /compute/v2.1/servers/6e2ab0bb-d92f-4441-bdea-2bc427e441f8 => generated 1264 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:38:00.811999 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [req-ee41839e-7ff8-48ef-b7f9-3ed52972ce9e req-1e72f199-8fe0-4332-85a4-2dc757b57aa1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e2ab0bb-d92f-4441-bdea-2bc427e441f8", "name": "network-vif-plugged", "status": "completed", "tag": "9c584805-1812-494e-8d2b-019452f06e9c"}]} {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:38:00.820653 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [req-ee41839e-7ff8-48ef-b7f9-3ed52972ce9e req-1e72f199-8fe0-4332-85a4-2dc757b57aa1 service nova] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:38:00.821095 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [req-ee41839e-7ff8-48ef-b7f9-3ed52972ce9e req-1e72f199-8fe0-4332-85a4-2dc757b57aa1 service nova] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:38:00.831329 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.compute.server_external_events [req-ee41839e-7ff8-48ef-b7f9-3ed52972ce9e req-1e72f199-8fe0-4332-85a4-2dc757b57aa1 service nova] Creating event network-vif-plugged:9c584805-1812-494e-8d2b-019452f06e9c for instance 6e2ab0bb-d92f-4441-bdea-2bc427e441f8 on hv-cinder-83754 Jul 18 10:38:00.836125 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [req-ee41839e-7ff8-48ef-b7f9-3ed52972ce9e req-1e72f199-8fe0-4332-85a4-2dc757b57aa1 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028414 Jul 18 10:38:00.836721 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 501/997] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jul 18 10:38:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:38:01.235197 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-f4b1cb72-2b62-4df1-93ba-27ed71968f2b tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:38:01.235815 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-f4b1cb72-2b62-4df1-93ba-27ed71968f2b tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] [instance: 6e2ab0bb-d92f-4441-bdea-2bc427e441f8] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:38:01.242341 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-f4b1cb72-2b62-4df1-93ba-27ed71968f2b tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:38:01.242791 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-f4b1cb72-2b62-4df1-93ba-27ed71968f2b tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:38:01.243556 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-f4b1cb72-2b62-4df1-93ba-27ed71968f2b tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:38:01.243994 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-f4b1cb72-2b62-4df1-93ba-27ed71968f2b tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:38:01.382642 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-f4b1cb72-2b62-4df1-93ba-27ed71968f2b tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9eb8d188e040bca894e038955f2402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c656b71bbd447cba7d11335c928dfda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:38:01.390541 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-f4b1cb72-2b62-4df1-93ba-27ed71968f2b tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] 10.222.0.33 "GET /compute/v2.1/servers/6e2ab0bb-d92f-4441-bdea-2bc427e441f8" status: 200 len: 1264 microversion: 2.1 time: 0.159212 Jul 18 10:38:01.391099 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 497/998] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:38:01 2022] GET /compute/v2.1/servers/6e2ab0bb-d92f-4441-bdea-2bc427e441f8 => generated 1264 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:38:02.407715 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-791ffafd-472a-44f1-89a1-5ff748b6fa9e tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:38:02.408399 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-791ffafd-472a-44f1-89a1-5ff748b6fa9e tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] [instance: 6e2ab0bb-d92f-4441-bdea-2bc427e441f8] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:38:02.414974 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-791ffafd-472a-44f1-89a1-5ff748b6fa9e tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:38:02.415423 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-791ffafd-472a-44f1-89a1-5ff748b6fa9e tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:38:02.416183 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-791ffafd-472a-44f1-89a1-5ff748b6fa9e tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:38:02.416705 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-791ffafd-472a-44f1-89a1-5ff748b6fa9e tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:38:02.549570 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-791ffafd-472a-44f1-89a1-5ff748b6fa9e tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9eb8d188e040bca894e038955f2402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c656b71bbd447cba7d11335c928dfda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:38:02.557361 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-791ffafd-472a-44f1-89a1-5ff748b6fa9e tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] 10.222.0.33 "GET /compute/v2.1/servers/6e2ab0bb-d92f-4441-bdea-2bc427e441f8" status: 200 len: 1264 microversion: 2.1 time: 0.153272 Jul 18 10:38:02.557896 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 502/999] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:38:02 2022] GET /compute/v2.1/servers/6e2ab0bb-d92f-4441-bdea-2bc427e441f8 => generated 1264 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:38:03.575308 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-efea1b40-4225-448f-9cb6-2323dc72da77 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:38:03.576043 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-efea1b40-4225-448f-9cb6-2323dc72da77 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] [instance: 6e2ab0bb-d92f-4441-bdea-2bc427e441f8] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:38:03.583297 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-efea1b40-4225-448f-9cb6-2323dc72da77 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:38:03.583956 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-efea1b40-4225-448f-9cb6-2323dc72da77 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:38:03.584827 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-efea1b40-4225-448f-9cb6-2323dc72da77 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:38:03.585573 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-efea1b40-4225-448f-9cb6-2323dc72da77 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:38:03.667326 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-91f5d182-20f7-42f1-b6f2-b43bef6bd0db tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:38:03.667963 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-91f5d182-20f7-42f1-b6f2-b43bef6bd0db tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] [instance: 7c4da4be-98d3-4976-97aa-a3ca9b8ddf96] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:38:03.674508 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-91f5d182-20f7-42f1-b6f2-b43bef6bd0db tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:38:03.675009 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-91f5d182-20f7-42f1-b6f2-b43bef6bd0db tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:38:03.675885 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-91f5d182-20f7-42f1-b6f2-b43bef6bd0db tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:38:03.676352 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-91f5d182-20f7-42f1-b6f2-b43bef6bd0db tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:38:03.699906 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-91f5d182-20f7-42f1-b6f2-b43bef6bd0db tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] 10.222.0.33 "GET /compute/v2.1/servers/7c4da4be-98d3-4976-97aa-a3ca9b8ddf96/ips" status: 200 len: 151 microversion: 2.20 time: 0.036437 Jul 18 10:38:03.700686 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 503/1000] 10.222.0.33 () {60 vars in 1288 bytes} [Mon Jul 18 10:38:03 2022] GET /compute/v2.1/servers/7c4da4be-98d3-4976-97aa-a3ca9b8ddf96/ips => generated 151 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 18 10:38:03.726970 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-efea1b40-4225-448f-9cb6-2323dc72da77 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9eb8d188e040bca894e038955f2402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c656b71bbd447cba7d11335c928dfda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:38:03.734978 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-efea1b40-4225-448f-9cb6-2323dc72da77 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] 10.222.0.33 "GET /compute/v2.1/servers/6e2ab0bb-d92f-4441-bdea-2bc427e441f8" status: 200 len: 1450 microversion: 2.1 time: 0.164731 Jul 18 10:38:03.735541 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 498/1001] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:38:03 2022] GET /compute/v2.1/servers/6e2ab0bb-d92f-4441-bdea-2bc427e441f8 => generated 1450 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:38:03.750692 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-dec447d6-da66-44f2-86c0-d5e8c8e370fd tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:38:03.751301 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-dec447d6-da66-44f2-86c0-d5e8c8e370fd tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] [instance: 6e2ab0bb-d92f-4441-bdea-2bc427e441f8] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:38:03.757215 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-dec447d6-da66-44f2-86c0-d5e8c8e370fd tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:38:03.757684 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-dec447d6-da66-44f2-86c0-d5e8c8e370fd tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:38:03.758434 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-dec447d6-da66-44f2-86c0-d5e8c8e370fd tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:38:03.758874 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-dec447d6-da66-44f2-86c0-d5e8c8e370fd tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:38:03.903804 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-dec447d6-da66-44f2-86c0-d5e8c8e370fd tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9eb8d188e040bca894e038955f2402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c656b71bbd447cba7d11335c928dfda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:38:03.915622 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-dec447d6-da66-44f2-86c0-d5e8c8e370fd tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] 10.222.0.33 "GET /compute/v2.1/servers/6e2ab0bb-d92f-4441-bdea-2bc427e441f8" status: 200 len: 1450 microversion: 2.1 time: 0.165132 Jul 18 10:38:03.915622 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 504/1002] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:38:03 2022] GET /compute/v2.1/servers/6e2ab0bb-d92f-4441-bdea-2bc427e441f8 => generated 1450 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:38:05.512812 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [req-c7800c0b-704a-4d86-84b0-304600889215 req-112a92f8-c7a8-4a4e-8b0d-a065222ea8ac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6e2ab0bb-d92f-4441-bdea-2bc427e441f8", "tag": "9c584805-1812-494e-8d2b-019452f06e9c"}]} {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:38:05.521239 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [req-c7800c0b-704a-4d86-84b0-304600889215 req-112a92f8-c7a8-4a4e-8b0d-a065222ea8ac service nova] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:38:05.521776 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [req-c7800c0b-704a-4d86-84b0-304600889215 req-112a92f8-c7a8-4a4e-8b0d-a065222ea8ac service nova] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:38:05.532807 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.compute.server_external_events [req-c7800c0b-704a-4d86-84b0-304600889215 req-112a92f8-c7a8-4a4e-8b0d-a065222ea8ac service nova] Creating event network-changed:9c584805-1812-494e-8d2b-019452f06e9c for instance 6e2ab0bb-d92f-4441-bdea-2bc427e441f8 on hv-cinder-83754 Jul 18 10:38:05.537665 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [req-c7800c0b-704a-4d86-84b0-304600889215 req-112a92f8-c7a8-4a4e-8b0d-a065222ea8ac service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029201 Jul 18 10:38:05.538401 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 499/1003] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jul 18 10:38:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:38:05.574666 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-dd3aebf1-ffe8-4577-aa21-3121db11aa69 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:38:05.575360 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-dd3aebf1-ffe8-4577-aa21-3121db11aa69 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] [instance: 7c4da4be-98d3-4976-97aa-a3ca9b8ddf96] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:38:05.582403 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-dd3aebf1-ffe8-4577-aa21-3121db11aa69 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:38:05.583010 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-dd3aebf1-ffe8-4577-aa21-3121db11aa69 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:38:05.584186 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-dd3aebf1-ffe8-4577-aa21-3121db11aa69 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:38:05.584754 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-dd3aebf1-ffe8-4577-aa21-3121db11aa69 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:38:05.609598 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.objects.instance [None req-dd3aebf1-ffe8-4577-aa21-3121db11aa69 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lazy-loading 'flavor' on Instance uuid 7c4da4be-98d3-4976-97aa-a3ca9b8ddf96 {{(pid=117879) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 10:38:05.905398 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-dd3aebf1-ffe8-4577-aa21-3121db11aa69 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] 10.222.0.33 "POST /compute/v2.1/servers/7c4da4be-98d3-4976-97aa-a3ca9b8ddf96/action" status: 202 len: 0 microversion: 2.20 time: 0.335259 Jul 18 10:38:05.910656 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 505/1004] 10.222.0.33 () {62 vars in 1318 bytes} [Mon Jul 18 10:38:05 2022] POST /compute/v2.1/servers/7c4da4be-98d3-4976-97aa-a3ca9b8ddf96/action => generated 0 bytes in 342 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 18 10:38:05.917251 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-3bc42ee0-9e9a-4f94-b3bf-bd252a0c56af tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:38:05.918090 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-3bc42ee0-9e9a-4f94-b3bf-bd252a0c56af tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] [instance: 7c4da4be-98d3-4976-97aa-a3ca9b8ddf96] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:38:05.932923 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-3bc42ee0-9e9a-4f94-b3bf-bd252a0c56af tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:38:05.933774 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-3bc42ee0-9e9a-4f94-b3bf-bd252a0c56af tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:38:05.934803 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-3bc42ee0-9e9a-4f94-b3bf-bd252a0c56af tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:38:05.935277 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-3bc42ee0-9e9a-4f94-b3bf-bd252a0c56af tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:38:06.162360 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-3bc42ee0-9e9a-4f94-b3bf-bd252a0c56af tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:38:06.172102 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-3bc42ee0-9e9a-4f94-b3bf-bd252a0c56af tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:38:06.173791 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-3bc42ee0-9e9a-4f94-b3bf-bd252a0c56af tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:38:06.181267 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-3bc42ee0-9e9a-4f94-b3bf-bd252a0c56af tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] 10.222.0.33 "GET /compute/v2.1/servers/7c4da4be-98d3-4976-97aa-a3ca9b8ddf96" status: 200 len: 1724 microversion: 2.20 time: 0.268519 Jul 18 10:38:06.182069 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 500/1005] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jul 18 10:38:05 2022] GET /compute/v2.1/servers/7c4da4be-98d3-4976-97aa-a3ca9b8ddf96 => generated 1724 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:38:07.200162 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-3bb45d1c-117d-41c4-ad11-cf7d772f1c59 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:38:07.200916 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-3bb45d1c-117d-41c4-ad11-cf7d772f1c59 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] [instance: 7c4da4be-98d3-4976-97aa-a3ca9b8ddf96] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:38:07.207149 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-3bb45d1c-117d-41c4-ad11-cf7d772f1c59 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:38:07.207604 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-3bb45d1c-117d-41c4-ad11-cf7d772f1c59 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:38:07.208365 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-3bb45d1c-117d-41c4-ad11-cf7d772f1c59 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:38:07.208874 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-3bb45d1c-117d-41c4-ad11-cf7d772f1c59 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:38:07.348206 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-3bb45d1c-117d-41c4-ad11-cf7d772f1c59 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:38:07.356996 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-3bb45d1c-117d-41c4-ad11-cf7d772f1c59 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:38:07.358497 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-3bb45d1c-117d-41c4-ad11-cf7d772f1c59 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:38:07.359632 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-3bb45d1c-117d-41c4-ad11-cf7d772f1c59 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] 10.222.0.33 "GET /compute/v2.1/servers/7c4da4be-98d3-4976-97aa-a3ca9b8ddf96" status: 200 len: 1724 microversion: 2.20 time: 0.164255 Jul 18 10:38:07.360183 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 506/1006] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jul 18 10:38:07 2022] GET /compute/v2.1/servers/7c4da4be-98d3-4976-97aa-a3ca9b8ddf96 => generated 1724 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:38:08.378145 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-f4a62d68-a1fe-47bb-8b35-6234e57f6817 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:38:08.378832 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-f4a62d68-a1fe-47bb-8b35-6234e57f6817 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] [instance: 7c4da4be-98d3-4976-97aa-a3ca9b8ddf96] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:38:08.385906 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-f4a62d68-a1fe-47bb-8b35-6234e57f6817 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:38:08.386470 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-f4a62d68-a1fe-47bb-8b35-6234e57f6817 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:38:08.387396 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-f4a62d68-a1fe-47bb-8b35-6234e57f6817 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:38:08.387832 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-f4a62d68-a1fe-47bb-8b35-6234e57f6817 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:38:08.543967 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-f4a62d68-a1fe-47bb-8b35-6234e57f6817 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:38:08.551983 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-f4a62d68-a1fe-47bb-8b35-6234e57f6817 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:38:08.553690 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-f4a62d68-a1fe-47bb-8b35-6234e57f6817 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:38:08.555283 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-f4a62d68-a1fe-47bb-8b35-6234e57f6817 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] 10.222.0.33 "GET /compute/v2.1/servers/7c4da4be-98d3-4976-97aa-a3ca9b8ddf96" status: 200 len: 1724 microversion: 2.20 time: 0.180821 Jul 18 10:38:08.555860 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 501/1007] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jul 18 10:38:08 2022] GET /compute/v2.1/servers/7c4da4be-98d3-4976-97aa-a3ca9b8ddf96 => generated 1724 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:38:09.574238 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-75ab082e-998f-4641-8d08-df30f5eaa50d tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:38:09.574837 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-75ab082e-998f-4641-8d08-df30f5eaa50d tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] [instance: 7c4da4be-98d3-4976-97aa-a3ca9b8ddf96] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:38:09.581562 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-75ab082e-998f-4641-8d08-df30f5eaa50d tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:38:09.582010 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-75ab082e-998f-4641-8d08-df30f5eaa50d tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:38:09.582774 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-75ab082e-998f-4641-8d08-df30f5eaa50d tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:38:09.583208 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-75ab082e-998f-4641-8d08-df30f5eaa50d tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:38:09.719941 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-75ab082e-998f-4641-8d08-df30f5eaa50d tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:38:09.730111 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-75ab082e-998f-4641-8d08-df30f5eaa50d tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:38:09.731604 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-75ab082e-998f-4641-8d08-df30f5eaa50d tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:38:09.733249 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-75ab082e-998f-4641-8d08-df30f5eaa50d tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] 10.222.0.33 "GET /compute/v2.1/servers/7c4da4be-98d3-4976-97aa-a3ca9b8ddf96" status: 200 len: 1724 microversion: 2.20 time: 0.163041 Jul 18 10:38:09.733963 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 507/1008] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jul 18 10:38:09 2022] GET /compute/v2.1/servers/7c4da4be-98d3-4976-97aa-a3ca9b8ddf96 => generated 1724 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:38:10.752379 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-d7e62765-034d-42f8-bc0e-25586a51f77b tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:38:10.753030 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-d7e62765-034d-42f8-bc0e-25586a51f77b tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] [instance: 7c4da4be-98d3-4976-97aa-a3ca9b8ddf96] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:38:10.759613 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-d7e62765-034d-42f8-bc0e-25586a51f77b tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:38:10.760652 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-d7e62765-034d-42f8-bc0e-25586a51f77b tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:38:10.761791 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-d7e62765-034d-42f8-bc0e-25586a51f77b tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:38:10.762315 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-d7e62765-034d-42f8-bc0e-25586a51f77b tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:38:10.891328 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-d7e62765-034d-42f8-bc0e-25586a51f77b tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:38:10.899262 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-d7e62765-034d-42f8-bc0e-25586a51f77b tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:38:10.900923 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-d7e62765-034d-42f8-bc0e-25586a51f77b tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:38:10.902079 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-d7e62765-034d-42f8-bc0e-25586a51f77b tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] 10.222.0.33 "GET /compute/v2.1/servers/7c4da4be-98d3-4976-97aa-a3ca9b8ddf96" status: 200 len: 1724 microversion: 2.20 time: 0.153611 Jul 18 10:38:10.902635 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 502/1009] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jul 18 10:38:10 2022] GET /compute/v2.1/servers/7c4da4be-98d3-4976-97aa-a3ca9b8ddf96 => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:38:11.919903 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-9ed1260b-3660-40ff-9ec2-c9e4ec4e5f57 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:38:11.920452 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-9ed1260b-3660-40ff-9ec2-c9e4ec4e5f57 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] [instance: 7c4da4be-98d3-4976-97aa-a3ca9b8ddf96] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:38:11.926894 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-9ed1260b-3660-40ff-9ec2-c9e4ec4e5f57 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:38:11.927347 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-9ed1260b-3660-40ff-9ec2-c9e4ec4e5f57 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:38:11.928113 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-9ed1260b-3660-40ff-9ec2-c9e4ec4e5f57 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:38:11.928581 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-9ed1260b-3660-40ff-9ec2-c9e4ec4e5f57 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:38:11.942849 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG dbcounter [-] [117879] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:38:12.056264 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-9ed1260b-3660-40ff-9ec2-c9e4ec4e5f57 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:38:12.064716 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-9ed1260b-3660-40ff-9ec2-c9e4ec4e5f57 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:38:12.066205 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-9ed1260b-3660-40ff-9ec2-c9e4ec4e5f57 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:38:12.067352 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-9ed1260b-3660-40ff-9ec2-c9e4ec4e5f57 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] 10.222.0.33 "GET /compute/v2.1/servers/7c4da4be-98d3-4976-97aa-a3ca9b8ddf96" status: 200 len: 1724 microversion: 2.20 time: 0.151450 Jul 18 10:38:12.067908 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 508/1010] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jul 18 10:38:11 2022] GET /compute/v2.1/servers/7c4da4be-98d3-4976-97aa-a3ca9b8ddf96 => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:38:13.085962 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-91622af8-dd6e-4380-b5b6-71e0ba91234c tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:38:13.086528 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-91622af8-dd6e-4380-b5b6-71e0ba91234c tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] [instance: 7c4da4be-98d3-4976-97aa-a3ca9b8ddf96] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:38:13.093096 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-91622af8-dd6e-4380-b5b6-71e0ba91234c tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:38:13.093543 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-91622af8-dd6e-4380-b5b6-71e0ba91234c tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:38:13.094301 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-91622af8-dd6e-4380-b5b6-71e0ba91234c tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:38:13.094735 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-91622af8-dd6e-4380-b5b6-71e0ba91234c tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:38:13.224319 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-91622af8-dd6e-4380-b5b6-71e0ba91234c tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:38:13.233384 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-91622af8-dd6e-4380-b5b6-71e0ba91234c tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:38:13.234881 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-91622af8-dd6e-4380-b5b6-71e0ba91234c tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:38:13.236479 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-91622af8-dd6e-4380-b5b6-71e0ba91234c tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] 10.222.0.33 "GET /compute/v2.1/servers/7c4da4be-98d3-4976-97aa-a3ca9b8ddf96" status: 200 len: 1724 microversion: 2.20 time: 0.154101 Jul 18 10:38:13.236638 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 503/1011] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jul 18 10:38:13 2022] GET /compute/v2.1/servers/7c4da4be-98d3-4976-97aa-a3ca9b8ddf96 => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:38:14.255127 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-91f37425-b988-4d65-9fc6-08e7b08b3b06 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:38:14.255722 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-91f37425-b988-4d65-9fc6-08e7b08b3b06 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] [instance: 7c4da4be-98d3-4976-97aa-a3ca9b8ddf96] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:38:14.261750 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-91f37425-b988-4d65-9fc6-08e7b08b3b06 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:38:14.262200 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-91f37425-b988-4d65-9fc6-08e7b08b3b06 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:38:14.262957 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-91f37425-b988-4d65-9fc6-08e7b08b3b06 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:38:14.263392 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-91f37425-b988-4d65-9fc6-08e7b08b3b06 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:38:14.388085 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-91f37425-b988-4d65-9fc6-08e7b08b3b06 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:38:14.396016 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-91f37425-b988-4d65-9fc6-08e7b08b3b06 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:38:14.397527 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-91f37425-b988-4d65-9fc6-08e7b08b3b06 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:38:14.398677 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-91f37425-b988-4d65-9fc6-08e7b08b3b06 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] 10.222.0.33 "GET /compute/v2.1/servers/7c4da4be-98d3-4976-97aa-a3ca9b8ddf96" status: 200 len: 1724 microversion: 2.20 time: 0.147602 Jul 18 10:38:14.399228 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 509/1012] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jul 18 10:38:14 2022] GET /compute/v2.1/servers/7c4da4be-98d3-4976-97aa-a3ca9b8ddf96 => generated 1724 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:38:15.417645 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-ae976098-012d-4791-9b4c-c7a5ad03b507 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:38:15.418182 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-ae976098-012d-4791-9b4c-c7a5ad03b507 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] [instance: 7c4da4be-98d3-4976-97aa-a3ca9b8ddf96] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:38:15.424627 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-ae976098-012d-4791-9b4c-c7a5ad03b507 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:38:15.425082 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-ae976098-012d-4791-9b4c-c7a5ad03b507 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:38:15.425842 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-ae976098-012d-4791-9b4c-c7a5ad03b507 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:38:15.426277 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-ae976098-012d-4791-9b4c-c7a5ad03b507 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:38:15.557790 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-ae976098-012d-4791-9b4c-c7a5ad03b507 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:38:15.565906 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-ae976098-012d-4791-9b4c-c7a5ad03b507 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:38:15.567398 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-ae976098-012d-4791-9b4c-c7a5ad03b507 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:38:15.568568 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-ae976098-012d-4791-9b4c-c7a5ad03b507 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] 10.222.0.33 "GET /compute/v2.1/servers/7c4da4be-98d3-4976-97aa-a3ca9b8ddf96" status: 200 len: 1724 microversion: 2.20 time: 0.155423 Jul 18 10:38:15.569122 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 504/1013] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jul 18 10:38:15 2022] GET /compute/v2.1/servers/7c4da4be-98d3-4976-97aa-a3ca9b8ddf96 => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:38:16.587619 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-e475f769-699e-4d52-b3c4-4b77ca008a4d tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:38:16.588162 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-e475f769-699e-4d52-b3c4-4b77ca008a4d tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] [instance: 7c4da4be-98d3-4976-97aa-a3ca9b8ddf96] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:38:16.594554 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-e475f769-699e-4d52-b3c4-4b77ca008a4d tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:38:16.595173 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-e475f769-699e-4d52-b3c4-4b77ca008a4d tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:38:16.595937 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-e475f769-699e-4d52-b3c4-4b77ca008a4d tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:38:16.596406 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-e475f769-699e-4d52-b3c4-4b77ca008a4d tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:38:16.720691 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-e475f769-699e-4d52-b3c4-4b77ca008a4d tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:38:16.728796 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-e475f769-699e-4d52-b3c4-4b77ca008a4d tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:38:16.730280 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-e475f769-699e-4d52-b3c4-4b77ca008a4d tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:38:16.731420 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-e475f769-699e-4d52-b3c4-4b77ca008a4d tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] 10.222.0.33 "GET /compute/v2.1/servers/7c4da4be-98d3-4976-97aa-a3ca9b8ddf96" status: 200 len: 1724 microversion: 2.20 time: 0.148335 Jul 18 10:38:16.731970 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 510/1014] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jul 18 10:38:16 2022] GET /compute/v2.1/servers/7c4da4be-98d3-4976-97aa-a3ca9b8ddf96 => generated 1724 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:38:17.749585 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-f7d7a10a-71ea-4b61-b90c-63ae3d11a285 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:38:17.750229 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-f7d7a10a-71ea-4b61-b90c-63ae3d11a285 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] [instance: 7c4da4be-98d3-4976-97aa-a3ca9b8ddf96] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:38:17.756395 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-f7d7a10a-71ea-4b61-b90c-63ae3d11a285 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:38:17.756872 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-f7d7a10a-71ea-4b61-b90c-63ae3d11a285 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:38:17.757672 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-f7d7a10a-71ea-4b61-b90c-63ae3d11a285 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:38:17.758101 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-f7d7a10a-71ea-4b61-b90c-63ae3d11a285 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:38:17.892868 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-f7d7a10a-71ea-4b61-b90c-63ae3d11a285 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:38:17.901241 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-f7d7a10a-71ea-4b61-b90c-63ae3d11a285 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:38:17.902736 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-f7d7a10a-71ea-4b61-b90c-63ae3d11a285 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:38:17.903878 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-f7d7a10a-71ea-4b61-b90c-63ae3d11a285 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] 10.222.0.33 "GET /compute/v2.1/servers/7c4da4be-98d3-4976-97aa-a3ca9b8ddf96" status: 200 len: 1724 microversion: 2.20 time: 0.158265 Jul 18 10:38:17.904437 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 505/1015] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jul 18 10:38:17 2022] GET /compute/v2.1/servers/7c4da4be-98d3-4976-97aa-a3ca9b8ddf96 => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:38:18.922033 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-c5b4a7d4-653c-4a5c-9a50-adeba638fb85 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:38:18.922640 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-c5b4a7d4-653c-4a5c-9a50-adeba638fb85 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] [instance: 7c4da4be-98d3-4976-97aa-a3ca9b8ddf96] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:38:18.929143 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-c5b4a7d4-653c-4a5c-9a50-adeba638fb85 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:38:18.929597 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-c5b4a7d4-653c-4a5c-9a50-adeba638fb85 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:38:18.930354 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-c5b4a7d4-653c-4a5c-9a50-adeba638fb85 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:38:18.930793 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-c5b4a7d4-653c-4a5c-9a50-adeba638fb85 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:38:19.057031 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-c5b4a7d4-653c-4a5c-9a50-adeba638fb85 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:38:19.064849 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-c5b4a7d4-653c-4a5c-9a50-adeba638fb85 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:38:19.066342 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-c5b4a7d4-653c-4a5c-9a50-adeba638fb85 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:38:19.067492 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-c5b4a7d4-653c-4a5c-9a50-adeba638fb85 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] 10.222.0.33 "GET /compute/v2.1/servers/7c4da4be-98d3-4976-97aa-a3ca9b8ddf96" status: 200 len: 1724 microversion: 2.20 time: 0.149370 Jul 18 10:38:19.068046 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 511/1016] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jul 18 10:38:18 2022] GET /compute/v2.1/servers/7c4da4be-98d3-4976-97aa-a3ca9b8ddf96 => generated 1724 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:38:20.086364 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-fef2b2ed-e466-405d-9e5b-e21c6c52b2f3 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:38:20.086978 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-fef2b2ed-e466-405d-9e5b-e21c6c52b2f3 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] [instance: 7c4da4be-98d3-4976-97aa-a3ca9b8ddf96] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:38:20.094093 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-fef2b2ed-e466-405d-9e5b-e21c6c52b2f3 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:38:20.094546 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-fef2b2ed-e466-405d-9e5b-e21c6c52b2f3 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:38:20.095335 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-fef2b2ed-e466-405d-9e5b-e21c6c52b2f3 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:38:20.095771 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-fef2b2ed-e466-405d-9e5b-e21c6c52b2f3 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:38:20.224963 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-fef2b2ed-e466-405d-9e5b-e21c6c52b2f3 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:38:20.233016 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-fef2b2ed-e466-405d-9e5b-e21c6c52b2f3 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:38:20.234522 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-fef2b2ed-e466-405d-9e5b-e21c6c52b2f3 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:38:20.235664 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-fef2b2ed-e466-405d-9e5b-e21c6c52b2f3 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] 10.222.0.33 "GET /compute/v2.1/servers/7c4da4be-98d3-4976-97aa-a3ca9b8ddf96" status: 200 len: 1724 microversion: 2.20 time: 0.153243 Jul 18 10:38:20.236214 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 506/1017] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jul 18 10:38:20 2022] GET /compute/v2.1/servers/7c4da4be-98d3-4976-97aa-a3ca9b8ddf96 => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:38:21.253981 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-c693eb0c-20d3-48e0-ba88-10933c91382c tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:38:21.254586 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-c693eb0c-20d3-48e0-ba88-10933c91382c tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] [instance: 7c4da4be-98d3-4976-97aa-a3ca9b8ddf96] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:38:21.261315 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-c693eb0c-20d3-48e0-ba88-10933c91382c tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:38:21.261765 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-c693eb0c-20d3-48e0-ba88-10933c91382c tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:38:21.262528 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-c693eb0c-20d3-48e0-ba88-10933c91382c tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:38:21.262964 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-c693eb0c-20d3-48e0-ba88-10933c91382c tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:38:21.392284 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-c693eb0c-20d3-48e0-ba88-10933c91382c tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:38:21.400038 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-c693eb0c-20d3-48e0-ba88-10933c91382c tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:38:21.402099 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-c693eb0c-20d3-48e0-ba88-10933c91382c tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:38:21.403250 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-c693eb0c-20d3-48e0-ba88-10933c91382c tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] 10.222.0.33 "GET /compute/v2.1/servers/7c4da4be-98d3-4976-97aa-a3ca9b8ddf96" status: 200 len: 1724 microversion: 2.20 time: 0.153225 Jul 18 10:38:21.403805 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 512/1018] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jul 18 10:38:21 2022] GET /compute/v2.1/servers/7c4da4be-98d3-4976-97aa-a3ca9b8ddf96 => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:38:22.422326 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-2b39bfa7-8240-476e-8aa5-f161919a80f9 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:38:22.422874 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-2b39bfa7-8240-476e-8aa5-f161919a80f9 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] [instance: 7c4da4be-98d3-4976-97aa-a3ca9b8ddf96] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:38:22.429332 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-2b39bfa7-8240-476e-8aa5-f161919a80f9 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:38:22.429775 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-2b39bfa7-8240-476e-8aa5-f161919a80f9 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:38:22.430544 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-2b39bfa7-8240-476e-8aa5-f161919a80f9 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:38:22.430974 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-2b39bfa7-8240-476e-8aa5-f161919a80f9 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:38:22.556848 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-2b39bfa7-8240-476e-8aa5-f161919a80f9 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:38:22.564712 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-2b39bfa7-8240-476e-8aa5-f161919a80f9 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:38:22.566222 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-2b39bfa7-8240-476e-8aa5-f161919a80f9 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:38:22.567362 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-2b39bfa7-8240-476e-8aa5-f161919a80f9 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] 10.222.0.33 "GET /compute/v2.1/servers/7c4da4be-98d3-4976-97aa-a3ca9b8ddf96" status: 200 len: 1724 microversion: 2.20 time: 0.149002 Jul 18 10:38:22.567911 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 507/1019] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jul 18 10:38:22 2022] GET /compute/v2.1/servers/7c4da4be-98d3-4976-97aa-a3ca9b8ddf96 => generated 1724 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 10:38:23.585218 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-2c53fce4-228f-4975-a717-98b1abc91f7d tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:38:23.585824 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-2c53fce4-228f-4975-a717-98b1abc91f7d tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] [instance: 7c4da4be-98d3-4976-97aa-a3ca9b8ddf96] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:38:23.593230 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-2c53fce4-228f-4975-a717-98b1abc91f7d tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:38:23.593709 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-2c53fce4-228f-4975-a717-98b1abc91f7d tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:38:23.594470 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-2c53fce4-228f-4975-a717-98b1abc91f7d tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:38:23.595052 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-2c53fce4-228f-4975-a717-98b1abc91f7d tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:38:23.727298 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-2c53fce4-228f-4975-a717-98b1abc91f7d tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:38:23.735745 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-2c53fce4-228f-4975-a717-98b1abc91f7d tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:38:23.737341 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-2c53fce4-228f-4975-a717-98b1abc91f7d tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:38:23.738480 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-2c53fce4-228f-4975-a717-98b1abc91f7d tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] 10.222.0.33 "GET /compute/v2.1/servers/7c4da4be-98d3-4976-97aa-a3ca9b8ddf96" status: 200 len: 1724 microversion: 2.20 time: 0.157259 Jul 18 10:38:23.739020 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 513/1020] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jul 18 10:38:23 2022] GET /compute/v2.1/servers/7c4da4be-98d3-4976-97aa-a3ca9b8ddf96 => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:38:24.757074 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-558da1d1-049b-493d-871b-62c3b4759c63 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:38:24.757615 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-558da1d1-049b-493d-871b-62c3b4759c63 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] [instance: 7c4da4be-98d3-4976-97aa-a3ca9b8ddf96] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:38:24.764534 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-558da1d1-049b-493d-871b-62c3b4759c63 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:38:24.764983 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-558da1d1-049b-493d-871b-62c3b4759c63 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:38:24.765735 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-558da1d1-049b-493d-871b-62c3b4759c63 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:38:24.766161 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-558da1d1-049b-493d-871b-62c3b4759c63 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:38:24.894037 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-558da1d1-049b-493d-871b-62c3b4759c63 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:38:24.901843 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-558da1d1-049b-493d-871b-62c3b4759c63 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:38:24.903321 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-558da1d1-049b-493d-871b-62c3b4759c63 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:38:24.904491 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-558da1d1-049b-493d-871b-62c3b4759c63 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] 10.222.0.33 "GET /compute/v2.1/servers/7c4da4be-98d3-4976-97aa-a3ca9b8ddf96" status: 200 len: 1724 microversion: 2.20 time: 0.151396 Jul 18 10:38:24.905093 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 508/1021] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jul 18 10:38:24 2022] GET /compute/v2.1/servers/7c4da4be-98d3-4976-97aa-a3ca9b8ddf96 => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:38:25.923223 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-ad4e1468-eabb-4a82-b245-de12249d35eb tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:38:25.923807 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-ad4e1468-eabb-4a82-b245-de12249d35eb tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] [instance: 7c4da4be-98d3-4976-97aa-a3ca9b8ddf96] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:38:25.930288 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-ad4e1468-eabb-4a82-b245-de12249d35eb tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:38:25.930734 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-ad4e1468-eabb-4a82-b245-de12249d35eb tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:38:25.931489 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-ad4e1468-eabb-4a82-b245-de12249d35eb tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:38:25.932672 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-ad4e1468-eabb-4a82-b245-de12249d35eb tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:38:26.058305 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-ad4e1468-eabb-4a82-b245-de12249d35eb tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:38:26.066140 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-ad4e1468-eabb-4a82-b245-de12249d35eb tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:38:26.067629 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-ad4e1468-eabb-4a82-b245-de12249d35eb tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:38:26.068807 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-ad4e1468-eabb-4a82-b245-de12249d35eb tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] 10.222.0.33 "GET /compute/v2.1/servers/7c4da4be-98d3-4976-97aa-a3ca9b8ddf96" status: 200 len: 1724 microversion: 2.20 time: 0.149427 Jul 18 10:38:26.069461 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 514/1022] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jul 18 10:38:25 2022] GET /compute/v2.1/servers/7c4da4be-98d3-4976-97aa-a3ca9b8ddf96 => generated 1724 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:38:27.086849 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-d094bd26-f025-4a36-9342-fd9113af61a3 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:38:27.087451 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-d094bd26-f025-4a36-9342-fd9113af61a3 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] [instance: 7c4da4be-98d3-4976-97aa-a3ca9b8ddf96] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:38:27.093996 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-d094bd26-f025-4a36-9342-fd9113af61a3 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:38:27.094444 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-d094bd26-f025-4a36-9342-fd9113af61a3 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:38:27.095200 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-d094bd26-f025-4a36-9342-fd9113af61a3 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:38:27.095630 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-d094bd26-f025-4a36-9342-fd9113af61a3 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:38:27.227593 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-d094bd26-f025-4a36-9342-fd9113af61a3 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:38:27.235910 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-d094bd26-f025-4a36-9342-fd9113af61a3 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:38:27.237429 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-d094bd26-f025-4a36-9342-fd9113af61a3 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:38:27.238572 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-d094bd26-f025-4a36-9342-fd9113af61a3 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] 10.222.0.33 "GET /compute/v2.1/servers/7c4da4be-98d3-4976-97aa-a3ca9b8ddf96" status: 200 len: 1745 microversion: 2.20 time: 0.155654 Jul 18 10:38:27.239120 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 509/1023] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jul 18 10:38:27 2022] GET /compute/v2.1/servers/7c4da4be-98d3-4976-97aa-a3ca9b8ddf96 => generated 1745 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:38:28.256932 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-79187e9d-a5f5-49b4-a58e-abf071492351 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:38:28.257530 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-79187e9d-a5f5-49b4-a58e-abf071492351 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] [instance: 7c4da4be-98d3-4976-97aa-a3ca9b8ddf96] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:38:28.263899 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-79187e9d-a5f5-49b4-a58e-abf071492351 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:38:28.264346 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-79187e9d-a5f5-49b4-a58e-abf071492351 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:38:28.265139 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-79187e9d-a5f5-49b4-a58e-abf071492351 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:38:28.265573 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-79187e9d-a5f5-49b4-a58e-abf071492351 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:38:28.390198 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-79187e9d-a5f5-49b4-a58e-abf071492351 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:38:28.398013 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-79187e9d-a5f5-49b4-a58e-abf071492351 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:38:28.399488 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-79187e9d-a5f5-49b4-a58e-abf071492351 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:38:28.400648 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-79187e9d-a5f5-49b4-a58e-abf071492351 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] 10.222.0.33 "GET /compute/v2.1/servers/7c4da4be-98d3-4976-97aa-a3ca9b8ddf96" status: 200 len: 1745 microversion: 2.20 time: 0.147735 Jul 18 10:38:28.401195 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 515/1024] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jul 18 10:38:28 2022] GET /compute/v2.1/servers/7c4da4be-98d3-4976-97aa-a3ca9b8ddf96 => generated 1745 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:38:29.418588 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-36791938-4131-4575-96d4-b36e09871c3c tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:38:29.419342 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-36791938-4131-4575-96d4-b36e09871c3c tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] [instance: 7c4da4be-98d3-4976-97aa-a3ca9b8ddf96] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:38:29.421808 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG dbcounter [-] [117880] Writing DB stats nova_api:SELECT=30 {{(pid=117880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:38:29.427131 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-36791938-4131-4575-96d4-b36e09871c3c tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:38:29.427436 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-36791938-4131-4575-96d4-b36e09871c3c tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:38:29.428201 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-36791938-4131-4575-96d4-b36e09871c3c tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:38:29.428664 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-36791938-4131-4575-96d4-b36e09871c3c tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:38:29.431506 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG dbcounter [-] [117880] Writing DB stats nova_cell1:SELECT=90 {{(pid=117880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:38:29.586594 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-36791938-4131-4575-96d4-b36e09871c3c tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:38:29.596957 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-36791938-4131-4575-96d4-b36e09871c3c tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:38:29.598449 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-36791938-4131-4575-96d4-b36e09871c3c tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:38:29.599617 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-36791938-4131-4575-96d4-b36e09871c3c tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] 10.222.0.33 "GET /compute/v2.1/servers/7c4da4be-98d3-4976-97aa-a3ca9b8ddf96" status: 200 len: 1740 microversion: 2.20 time: 0.185623 Jul 18 10:38:29.600170 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 510/1025] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jul 18 10:38:29 2022] GET /compute/v2.1/servers/7c4da4be-98d3-4976-97aa-a3ca9b8ddf96 => generated 1740 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:38:30.620092 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-0d496c39-9ab6-429d-bf99-4110e74cb2d5 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:38:30.620787 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-0d496c39-9ab6-429d-bf99-4110e74cb2d5 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] [instance: 7c4da4be-98d3-4976-97aa-a3ca9b8ddf96] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:38:30.626759 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG dbcounter [-] [117879] Writing DB stats nova_api:SELECT=32 {{(pid=117879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:38:30.628958 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-0d496c39-9ab6-429d-bf99-4110e74cb2d5 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:38:30.629842 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-0d496c39-9ab6-429d-bf99-4110e74cb2d5 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:38:30.630875 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-0d496c39-9ab6-429d-bf99-4110e74cb2d5 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:38:30.631307 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-0d496c39-9ab6-429d-bf99-4110e74cb2d5 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:38:30.784465 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-0d496c39-9ab6-429d-bf99-4110e74cb2d5 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:38:30.793314 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-0d496c39-9ab6-429d-bf99-4110e74cb2d5 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:38:30.795189 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-0d496c39-9ab6-429d-bf99-4110e74cb2d5 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:38:30.796537 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-0d496c39-9ab6-429d-bf99-4110e74cb2d5 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] 10.222.0.33 "GET /compute/v2.1/servers/7c4da4be-98d3-4976-97aa-a3ca9b8ddf96" status: 200 len: 1740 microversion: 2.20 time: 0.180368 Jul 18 10:38:30.797304 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 516/1026] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jul 18 10:38:30 2022] GET /compute/v2.1/servers/7c4da4be-98d3-4976-97aa-a3ca9b8ddf96 => generated 1740 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:38:30.878475 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [req-bbb9bd63-6899-4159-bd79-0a6f9069237d req-d551650e-5065-4012-bf50-0835d12869e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c4da4be-98d3-4976-97aa-a3ca9b8ddf96", "name": "network-vif-plugged", "status": "completed", "tag": "1dcc8a67-356a-4505-8579-9742b691b360"}]} {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:38:30.888761 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [req-bbb9bd63-6899-4159-bd79-0a6f9069237d req-d551650e-5065-4012-bf50-0835d12869e4 service nova] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:38:30.889432 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [req-bbb9bd63-6899-4159-bd79-0a6f9069237d req-d551650e-5065-4012-bf50-0835d12869e4 service nova] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:38:30.903601 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.compute.server_external_events [req-bbb9bd63-6899-4159-bd79-0a6f9069237d req-d551650e-5065-4012-bf50-0835d12869e4 service nova] Creating event network-vif-plugged:1dcc8a67-356a-4505-8579-9742b691b360 for instance 7c4da4be-98d3-4976-97aa-a3ca9b8ddf96 on hv-cinder-83754 Jul 18 10:38:30.910897 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [req-bbb9bd63-6899-4159-bd79-0a6f9069237d req-d551650e-5065-4012-bf50-0835d12869e4 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037176 Jul 18 10:38:30.911563 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 511/1027] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jul 18 10:38:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:38:31.815741 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-69a55469-4bcf-4b3d-b2f5-d8a68181fc84 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:38:31.816470 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-69a55469-4bcf-4b3d-b2f5-d8a68181fc84 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] [instance: 7c4da4be-98d3-4976-97aa-a3ca9b8ddf96] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:38:31.824199 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-69a55469-4bcf-4b3d-b2f5-d8a68181fc84 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:38:31.824723 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-69a55469-4bcf-4b3d-b2f5-d8a68181fc84 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:38:31.826139 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-69a55469-4bcf-4b3d-b2f5-d8a68181fc84 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:38:31.826588 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-69a55469-4bcf-4b3d-b2f5-d8a68181fc84 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:38:31.968118 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-69a55469-4bcf-4b3d-b2f5-d8a68181fc84 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:38:31.976632 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-69a55469-4bcf-4b3d-b2f5-d8a68181fc84 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:38:31.978163 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-69a55469-4bcf-4b3d-b2f5-d8a68181fc84 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:38:31.979407 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-69a55469-4bcf-4b3d-b2f5-d8a68181fc84 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] 10.222.0.33 "GET /compute/v2.1/servers/7c4da4be-98d3-4976-97aa-a3ca9b8ddf96" status: 200 len: 1740 microversion: 2.20 time: 0.167660 Jul 18 10:38:31.980404 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 517/1028] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jul 18 10:38:31 2022] GET /compute/v2.1/servers/7c4da4be-98d3-4976-97aa-a3ca9b8ddf96 => generated 1740 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:38:32.999905 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-fa02d516-d4dd-43f4-8c95-f1fc294d0fe2 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:38:33.000627 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-fa02d516-d4dd-43f4-8c95-f1fc294d0fe2 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] [instance: 7c4da4be-98d3-4976-97aa-a3ca9b8ddf96] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:38:33.007231 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-fa02d516-d4dd-43f4-8c95-f1fc294d0fe2 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:38:33.007680 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-fa02d516-d4dd-43f4-8c95-f1fc294d0fe2 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:38:33.008482 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-fa02d516-d4dd-43f4-8c95-f1fc294d0fe2 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:38:33.008960 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-fa02d516-d4dd-43f4-8c95-f1fc294d0fe2 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:38:33.156382 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-fa02d516-d4dd-43f4-8c95-f1fc294d0fe2 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:38:33.165623 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-fa02d516-d4dd-43f4-8c95-f1fc294d0fe2 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:38:33.167132 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-fa02d516-d4dd-43f4-8c95-f1fc294d0fe2 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:38:33.168962 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-fa02d516-d4dd-43f4-8c95-f1fc294d0fe2 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] 10.222.0.33 "GET /compute/v2.1/servers/7c4da4be-98d3-4976-97aa-a3ca9b8ddf96" status: 200 len: 1740 microversion: 2.20 time: 0.174575 Jul 18 10:38:33.169831 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 512/1029] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jul 18 10:38:32 2022] GET /compute/v2.1/servers/7c4da4be-98d3-4976-97aa-a3ca9b8ddf96 => generated 1740 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:38:34.187733 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-f62c828e-9714-4a1e-9f0c-599121fc5a70 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:38:34.188437 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-f62c828e-9714-4a1e-9f0c-599121fc5a70 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] [instance: 7c4da4be-98d3-4976-97aa-a3ca9b8ddf96] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:38:34.195336 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-f62c828e-9714-4a1e-9f0c-599121fc5a70 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:38:34.195799 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-f62c828e-9714-4a1e-9f0c-599121fc5a70 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:38:34.196602 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-f62c828e-9714-4a1e-9f0c-599121fc5a70 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:38:34.197050 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-f62c828e-9714-4a1e-9f0c-599121fc5a70 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:38:34.343808 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-f62c828e-9714-4a1e-9f0c-599121fc5a70 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:38:34.354203 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-f62c828e-9714-4a1e-9f0c-599121fc5a70 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:38:34.356371 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-f62c828e-9714-4a1e-9f0c-599121fc5a70 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:38:34.358555 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-f62c828e-9714-4a1e-9f0c-599121fc5a70 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] 10.222.0.33 "GET /compute/v2.1/servers/7c4da4be-98d3-4976-97aa-a3ca9b8ddf96" status: 200 len: 1740 microversion: 2.20 time: 0.174990 Jul 18 10:38:34.359369 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 518/1030] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jul 18 10:38:34 2022] GET /compute/v2.1/servers/7c4da4be-98d3-4976-97aa-a3ca9b8ddf96 => generated 1740 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:38:35.378058 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-970e225b-f362-44ae-8681-35e34f3ae68d tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:38:35.379338 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-970e225b-f362-44ae-8681-35e34f3ae68d tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] [instance: 7c4da4be-98d3-4976-97aa-a3ca9b8ddf96] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:38:35.386166 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-970e225b-f362-44ae-8681-35e34f3ae68d tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:38:35.386666 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-970e225b-f362-44ae-8681-35e34f3ae68d tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:38:35.387849 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-970e225b-f362-44ae-8681-35e34f3ae68d tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:38:35.388232 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-970e225b-f362-44ae-8681-35e34f3ae68d tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:38:35.555449 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-970e225b-f362-44ae-8681-35e34f3ae68d tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:38:35.562913 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-970e225b-f362-44ae-8681-35e34f3ae68d tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:38:35.563566 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-970e225b-f362-44ae-8681-35e34f3ae68d tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:38:35.564919 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-970e225b-f362-44ae-8681-35e34f3ae68d tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] 10.222.0.33 "GET /compute/v2.1/servers/7c4da4be-98d3-4976-97aa-a3ca9b8ddf96" status: 200 len: 1740 microversion: 2.20 time: 0.191439 Jul 18 10:38:35.576341 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 513/1031] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jul 18 10:38:35 2022] GET /compute/v2.1/servers/7c4da4be-98d3-4976-97aa-a3ca9b8ddf96 => generated 1740 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:38:36.583496 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-8b6ff695-76ff-469b-8232-5895acfc4a69 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:38:36.584045 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-8b6ff695-76ff-469b-8232-5895acfc4a69 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] [instance: 7c4da4be-98d3-4976-97aa-a3ca9b8ddf96] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:38:36.591435 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-8b6ff695-76ff-469b-8232-5895acfc4a69 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:38:36.592790 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-8b6ff695-76ff-469b-8232-5895acfc4a69 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:38:36.596339 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-8b6ff695-76ff-469b-8232-5895acfc4a69 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:38:36.597667 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-8b6ff695-76ff-469b-8232-5895acfc4a69 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:38:36.772775 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-8b6ff695-76ff-469b-8232-5895acfc4a69 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:38:36.781682 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-8b6ff695-76ff-469b-8232-5895acfc4a69 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:38:36.783660 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-8b6ff695-76ff-469b-8232-5895acfc4a69 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:38:36.785238 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-8b6ff695-76ff-469b-8232-5895acfc4a69 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] 10.222.0.33 "GET /compute/v2.1/servers/7c4da4be-98d3-4976-97aa-a3ca9b8ddf96" status: 200 len: 1740 microversion: 2.20 time: 0.205745 Jul 18 10:38:36.786187 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 519/1032] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jul 18 10:38:36 2022] GET /compute/v2.1/servers/7c4da4be-98d3-4976-97aa-a3ca9b8ddf96 => generated 1740 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:38:37.807169 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-ed8a643d-9fd4-4062-be80-f8bf551e2fca tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:38:37.807782 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-ed8a643d-9fd4-4062-be80-f8bf551e2fca tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] [instance: 7c4da4be-98d3-4976-97aa-a3ca9b8ddf96] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:38:37.814702 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-ed8a643d-9fd4-4062-be80-f8bf551e2fca tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:38:37.815152 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-ed8a643d-9fd4-4062-be80-f8bf551e2fca tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:38:37.815930 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-ed8a643d-9fd4-4062-be80-f8bf551e2fca tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:38:37.816362 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-ed8a643d-9fd4-4062-be80-f8bf551e2fca tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:38:37.965791 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-ed8a643d-9fd4-4062-be80-f8bf551e2fca tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:38:37.974302 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-ed8a643d-9fd4-4062-be80-f8bf551e2fca tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:38:37.976202 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-ed8a643d-9fd4-4062-be80-f8bf551e2fca tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:38:37.977386 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-ed8a643d-9fd4-4062-be80-f8bf551e2fca tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] 10.222.0.33 "GET /compute/v2.1/servers/7c4da4be-98d3-4976-97aa-a3ca9b8ddf96" status: 200 len: 1740 microversion: 2.20 time: 0.174314 Jul 18 10:38:37.977943 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 514/1033] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jul 18 10:38:37 2022] GET /compute/v2.1/servers/7c4da4be-98d3-4976-97aa-a3ca9b8ddf96 => generated 1740 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:38:38.995762 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-5e4e0839-dc5d-4c46-8d56-c3fb12bec6e0 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:38:38.996458 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-5e4e0839-dc5d-4c46-8d56-c3fb12bec6e0 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] [instance: 7c4da4be-98d3-4976-97aa-a3ca9b8ddf96] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:38:39.003008 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-5e4e0839-dc5d-4c46-8d56-c3fb12bec6e0 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:38:39.003460 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-5e4e0839-dc5d-4c46-8d56-c3fb12bec6e0 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:38:39.004235 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-5e4e0839-dc5d-4c46-8d56-c3fb12bec6e0 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:38:39.004707 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-5e4e0839-dc5d-4c46-8d56-c3fb12bec6e0 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:38:39.156021 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-5e4e0839-dc5d-4c46-8d56-c3fb12bec6e0 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:38:39.164052 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-5e4e0839-dc5d-4c46-8d56-c3fb12bec6e0 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:38:39.165583 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-5e4e0839-dc5d-4c46-8d56-c3fb12bec6e0 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:38:39.166733 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-5e4e0839-dc5d-4c46-8d56-c3fb12bec6e0 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] 10.222.0.33 "GET /compute/v2.1/servers/7c4da4be-98d3-4976-97aa-a3ca9b8ddf96" status: 200 len: 1722 microversion: 2.20 time: 0.174897 Jul 18 10:38:39.167288 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 520/1034] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jul 18 10:38:38 2022] GET /compute/v2.1/servers/7c4da4be-98d3-4976-97aa-a3ca9b8ddf96 => generated 1722 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:38:40.185529 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-08acff81-199b-4c52-9a74-c3fcd2dcaed2 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:38:40.186133 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-08acff81-199b-4c52-9a74-c3fcd2dcaed2 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] [instance: 7c4da4be-98d3-4976-97aa-a3ca9b8ddf96] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:38:40.192618 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-08acff81-199b-4c52-9a74-c3fcd2dcaed2 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:38:40.193069 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-08acff81-199b-4c52-9a74-c3fcd2dcaed2 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:38:40.193831 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-08acff81-199b-4c52-9a74-c3fcd2dcaed2 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:38:40.194260 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-08acff81-199b-4c52-9a74-c3fcd2dcaed2 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:38:40.319891 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-08acff81-199b-4c52-9a74-c3fcd2dcaed2 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:38:40.328391 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-08acff81-199b-4c52-9a74-c3fcd2dcaed2 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:38:40.329911 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-08acff81-199b-4c52-9a74-c3fcd2dcaed2 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:38:40.331063 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-08acff81-199b-4c52-9a74-c3fcd2dcaed2 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] 10.222.0.33 "GET /compute/v2.1/servers/7c4da4be-98d3-4976-97aa-a3ca9b8ddf96" status: 200 len: 1722 microversion: 2.20 time: 0.149935 Jul 18 10:38:40.331616 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 515/1035] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jul 18 10:38:40 2022] GET /compute/v2.1/servers/7c4da4be-98d3-4976-97aa-a3ca9b8ddf96 => generated 1722 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:38:41.349001 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-da93f682-4b05-4a0f-a9bd-ab5b1c967763 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:38:41.349596 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-da93f682-4b05-4a0f-a9bd-ab5b1c967763 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] [instance: 7c4da4be-98d3-4976-97aa-a3ca9b8ddf96] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:38:41.357145 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-da93f682-4b05-4a0f-a9bd-ab5b1c967763 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:38:41.357598 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-da93f682-4b05-4a0f-a9bd-ab5b1c967763 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:38:41.358358 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-da93f682-4b05-4a0f-a9bd-ab5b1c967763 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:38:41.358857 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-da93f682-4b05-4a0f-a9bd-ab5b1c967763 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:38:41.488466 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-da93f682-4b05-4a0f-a9bd-ab5b1c967763 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:38:41.496226 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-da93f682-4b05-4a0f-a9bd-ab5b1c967763 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:38:41.497759 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-da93f682-4b05-4a0f-a9bd-ab5b1c967763 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:38:41.498938 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-da93f682-4b05-4a0f-a9bd-ab5b1c967763 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] 10.222.0.33 "GET /compute/v2.1/servers/7c4da4be-98d3-4976-97aa-a3ca9b8ddf96" status: 200 len: 1665 microversion: 2.20 time: 0.153876 Jul 18 10:38:41.499505 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 521/1036] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jul 18 10:38:41 2022] GET /compute/v2.1/servers/7c4da4be-98d3-4976-97aa-a3ca9b8ddf96 => generated 1665 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:38:41.516759 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-479514b3-b7e1-4523-a073-8d8ecc6bca2c tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f1cd3536-ba0e-416c-9c97-d19e0f1fbc6a"}} {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:38:41.517815 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-479514b3-b7e1-4523-a073-8d8ecc6bca2c tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] [instance: 7c4da4be-98d3-4976-97aa-a3ca9b8ddf96] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:38:41.524241 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-479514b3-b7e1-4523-a073-8d8ecc6bca2c tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:38:41.524723 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-479514b3-b7e1-4523-a073-8d8ecc6bca2c tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:38:41.525490 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-479514b3-b7e1-4523-a073-8d8ecc6bca2c tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:38:41.525926 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-479514b3-b7e1-4523-a073-8d8ecc6bca2c tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:38:41.799434 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-479514b3-b7e1-4523-a073-8d8ecc6bca2c tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] 10.222.0.33 "POST /compute/v2.1/servers/7c4da4be-98d3-4976-97aa-a3ca9b8ddf96/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.286525 Jul 18 10:38:41.802912 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 516/1037] 10.222.0.33 () {62 vars in 1363 bytes} [Mon Jul 18 10:38:41 2022] POST /compute/v2.1/servers/7c4da4be-98d3-4976-97aa-a3ca9b8ddf96/os-volume_attachments => generated 188 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 10:38:41.910663 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-ee60cbeb-e03a-414b-bd6a-8df4402af54f tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:38:41.911161 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-ee60cbeb-e03a-414b-bd6a-8df4402af54f tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] [instance: 7c4da4be-98d3-4976-97aa-a3ca9b8ddf96] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:38:41.918409 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-ee60cbeb-e03a-414b-bd6a-8df4402af54f tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:38:41.918865 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-ee60cbeb-e03a-414b-bd6a-8df4402af54f tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:38:41.919632 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-ee60cbeb-e03a-414b-bd6a-8df4402af54f tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:38:41.920070 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-ee60cbeb-e03a-414b-bd6a-8df4402af54f tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:38:41.993472 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG dbcounter [-] [117879] Writing DB stats nova_cell1:SELECT=86 {{(pid=117879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:38:42.148071 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-ee60cbeb-e03a-414b-bd6a-8df4402af54f tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] 10.222.0.33 "DELETE /compute/v2.1/servers/7c4da4be-98d3-4976-97aa-a3ca9b8ddf96/os-volume_attachments/f1cd3536-ba0e-416c-9c97-d19e0f1fbc6a" status: 202 len: 0 microversion: 2.20 time: 0.241240 Jul 18 10:38:42.148675 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 522/1038] 10.222.0.33 () {60 vars in 1456 bytes} [Mon Jul 18 10:38:41 2022] DELETE /compute/v2.1/servers/7c4da4be-98d3-4976-97aa-a3ca9b8ddf96/os-volume_attachments/f1cd3536-ba0e-416c-9c97-d19e0f1fbc6a => generated 0 bytes in 243 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 18 10:38:42.203850 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-2d8c0b1f-847c-4e59-8fa0-05626363a03d tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:38:42.204407 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-2d8c0b1f-847c-4e59-8fa0-05626363a03d tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] [instance: 7c4da4be-98d3-4976-97aa-a3ca9b8ddf96] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:38:42.211054 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-2d8c0b1f-847c-4e59-8fa0-05626363a03d tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:38:42.211502 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-2d8c0b1f-847c-4e59-8fa0-05626363a03d tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:38:42.212253 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-2d8c0b1f-847c-4e59-8fa0-05626363a03d tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:38:42.212717 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-2d8c0b1f-847c-4e59-8fa0-05626363a03d tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:38:42.286241 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-2d8c0b1f-847c-4e59-8fa0-05626363a03d tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] 10.222.0.33 "POST /compute/v2.1/servers/7c4da4be-98d3-4976-97aa-a3ca9b8ddf96/action" status: 202 len: 0 microversion: 2.20 time: 0.086224 Jul 18 10:38:42.286742 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 517/1039] 10.222.0.33 () {62 vars in 1318 bytes} [Mon Jul 18 10:38:42 2022] POST /compute/v2.1/servers/7c4da4be-98d3-4976-97aa-a3ca9b8ddf96/action => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 18 10:38:42.297520 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-dfd693ac-e047-4043-9d2f-88a75052a4a7 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:38:42.298163 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-dfd693ac-e047-4043-9d2f-88a75052a4a7 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] [instance: 7c4da4be-98d3-4976-97aa-a3ca9b8ddf96] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:38:42.304045 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-dfd693ac-e047-4043-9d2f-88a75052a4a7 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:38:42.304498 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-dfd693ac-e047-4043-9d2f-88a75052a4a7 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:38:42.305286 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-dfd693ac-e047-4043-9d2f-88a75052a4a7 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:38:42.305716 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-dfd693ac-e047-4043-9d2f-88a75052a4a7 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:38:42.475912 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-dfd693ac-e047-4043-9d2f-88a75052a4a7 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:38:42.484438 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-dfd693ac-e047-4043-9d2f-88a75052a4a7 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:38:42.485955 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-dfd693ac-e047-4043-9d2f-88a75052a4a7 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:38:42.487106 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-dfd693ac-e047-4043-9d2f-88a75052a4a7 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] 10.222.0.33 "GET /compute/v2.1/servers/7c4da4be-98d3-4976-97aa-a3ca9b8ddf96" status: 200 len: 1673 microversion: 2.20 time: 0.196213 Jul 18 10:38:42.487653 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 523/1040] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jul 18 10:38:42 2022] GET /compute/v2.1/servers/7c4da4be-98d3-4976-97aa-a3ca9b8ddf96 => generated 1673 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 10:38:42.925807 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [req-e5e6a2ca-e89e-4788-b6b8-b8740455a0ac req-4da000bd-e57d-4195-8f86-5427a88f4a1e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c4da4be-98d3-4976-97aa-a3ca9b8ddf96", "name": "network-vif-unplugged", "status": "completed", "tag": "1dcc8a67-356a-4505-8579-9742b691b360"}]} {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:38:42.935675 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [req-e5e6a2ca-e89e-4788-b6b8-b8740455a0ac req-4da000bd-e57d-4195-8f86-5427a88f4a1e service nova] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:38:42.936116 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [req-e5e6a2ca-e89e-4788-b6b8-b8740455a0ac req-4da000bd-e57d-4195-8f86-5427a88f4a1e service nova] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:38:42.947741 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.compute.server_external_events [req-e5e6a2ca-e89e-4788-b6b8-b8740455a0ac req-4da000bd-e57d-4195-8f86-5427a88f4a1e service nova] Unable to find a host for instance 7c4da4be-98d3-4976-97aa-a3ca9b8ddf96. Dropping event network-vif-unplugged {{(pid=117880) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 18 10:38:42.949401 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [req-e5e6a2ca-e89e-4788-b6b8-b8740455a0ac req-4da000bd-e57d-4195-8f86-5427a88f4a1e service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.027850 Jul 18 10:38:42.949984 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 518/1041] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jul 18 10:38:42 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 29 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jul 18 10:38:43.505136 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-0007e842-67d0-415f-ba8e-0f763ee86c18 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:38:43.505884 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-0007e842-67d0-415f-ba8e-0f763ee86c18 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] [instance: 7c4da4be-98d3-4976-97aa-a3ca9b8ddf96] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:38:43.512602 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-0007e842-67d0-415f-ba8e-0f763ee86c18 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:38:43.513055 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-0007e842-67d0-415f-ba8e-0f763ee86c18 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:38:43.513814 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-0007e842-67d0-415f-ba8e-0f763ee86c18 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:38:43.514249 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-0007e842-67d0-415f-ba8e-0f763ee86c18 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:38:43.711117 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-0007e842-67d0-415f-ba8e-0f763ee86c18 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:38:43.719747 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-0007e842-67d0-415f-ba8e-0f763ee86c18 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:38:43.721377 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-0007e842-67d0-415f-ba8e-0f763ee86c18 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:38:43.722529 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-0007e842-67d0-415f-ba8e-0f763ee86c18 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] 10.222.0.33 "GET /compute/v2.1/servers/7c4da4be-98d3-4976-97aa-a3ca9b8ddf96" status: 200 len: 1731 microversion: 2.20 time: 0.221230 Jul 18 10:38:43.723084 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 524/1042] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jul 18 10:38:43 2022] GET /compute/v2.1/servers/7c4da4be-98d3-4976-97aa-a3ca9b8ddf96 => generated 1731 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:38:44.742104 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-6b22fb35-b2f3-4c95-8ff3-db2db826cffd tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:38:44.743394 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-6b22fb35-b2f3-4c95-8ff3-db2db826cffd tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] [instance: 7c4da4be-98d3-4976-97aa-a3ca9b8ddf96] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:38:44.751091 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-6b22fb35-b2f3-4c95-8ff3-db2db826cffd tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:38:44.751781 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-6b22fb35-b2f3-4c95-8ff3-db2db826cffd tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:38:44.752788 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-6b22fb35-b2f3-4c95-8ff3-db2db826cffd tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:38:44.753379 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-6b22fb35-b2f3-4c95-8ff3-db2db826cffd tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:38:44.896697 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-6b22fb35-b2f3-4c95-8ff3-db2db826cffd tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:38:44.905097 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-6b22fb35-b2f3-4c95-8ff3-db2db826cffd tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:38:44.906579 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-6b22fb35-b2f3-4c95-8ff3-db2db826cffd tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:38:44.907717 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-6b22fb35-b2f3-4c95-8ff3-db2db826cffd tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] 10.222.0.33 "GET /compute/v2.1/servers/7c4da4be-98d3-4976-97aa-a3ca9b8ddf96" status: 200 len: 1731 microversion: 2.20 time: 0.169483 Jul 18 10:38:44.908299 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 519/1043] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jul 18 10:38:44 2022] GET /compute/v2.1/servers/7c4da4be-98d3-4976-97aa-a3ca9b8ddf96 => generated 1731 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:38:45.926876 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-9188e386-fb7c-422c-89ea-94a48ddd15db tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:38:45.927481 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-9188e386-fb7c-422c-89ea-94a48ddd15db tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] [instance: 7c4da4be-98d3-4976-97aa-a3ca9b8ddf96] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:38:45.934016 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-9188e386-fb7c-422c-89ea-94a48ddd15db tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:38:45.934470 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-9188e386-fb7c-422c-89ea-94a48ddd15db tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:38:45.935234 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-9188e386-fb7c-422c-89ea-94a48ddd15db tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:38:45.935671 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-9188e386-fb7c-422c-89ea-94a48ddd15db tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:38:46.068292 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-9188e386-fb7c-422c-89ea-94a48ddd15db tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:38:46.077242 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-9188e386-fb7c-422c-89ea-94a48ddd15db tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:38:46.078788 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-9188e386-fb7c-422c-89ea-94a48ddd15db tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:38:46.079961 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-9188e386-fb7c-422c-89ea-94a48ddd15db tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] 10.222.0.33 "GET /compute/v2.1/servers/7c4da4be-98d3-4976-97aa-a3ca9b8ddf96" status: 200 len: 1731 microversion: 2.20 time: 0.156972 Jul 18 10:38:46.080564 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 525/1044] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jul 18 10:38:45 2022] GET /compute/v2.1/servers/7c4da4be-98d3-4976-97aa-a3ca9b8ddf96 => generated 1731 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:38:47.099580 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-26011053-bc1d-49dc-9e5b-b6b74bfdd235 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:38:47.100299 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-26011053-bc1d-49dc-9e5b-b6b74bfdd235 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] [instance: 7c4da4be-98d3-4976-97aa-a3ca9b8ddf96] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:38:47.107392 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-26011053-bc1d-49dc-9e5b-b6b74bfdd235 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:38:47.108270 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-26011053-bc1d-49dc-9e5b-b6b74bfdd235 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:38:47.110131 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-26011053-bc1d-49dc-9e5b-b6b74bfdd235 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:38:47.110962 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-26011053-bc1d-49dc-9e5b-b6b74bfdd235 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:38:47.254170 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-26011053-bc1d-49dc-9e5b-b6b74bfdd235 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:38:47.263600 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-26011053-bc1d-49dc-9e5b-b6b74bfdd235 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:38:47.265516 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-26011053-bc1d-49dc-9e5b-b6b74bfdd235 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:38:47.266945 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-26011053-bc1d-49dc-9e5b-b6b74bfdd235 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] 10.222.0.33 "GET /compute/v2.1/servers/7c4da4be-98d3-4976-97aa-a3ca9b8ddf96" status: 200 len: 1731 microversion: 2.20 time: 0.171792 Jul 18 10:38:47.267726 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 520/1045] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jul 18 10:38:47 2022] GET /compute/v2.1/servers/7c4da4be-98d3-4976-97aa-a3ca9b8ddf96 => generated 1731 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:38:48.285991 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-643743a8-a70e-48ee-8bb5-df78a5d514d7 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:38:48.286593 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-643743a8-a70e-48ee-8bb5-df78a5d514d7 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] [instance: 7c4da4be-98d3-4976-97aa-a3ca9b8ddf96] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:38:48.293754 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-643743a8-a70e-48ee-8bb5-df78a5d514d7 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:38:48.294371 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-643743a8-a70e-48ee-8bb5-df78a5d514d7 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:38:48.295138 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-643743a8-a70e-48ee-8bb5-df78a5d514d7 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:38:48.295576 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-643743a8-a70e-48ee-8bb5-df78a5d514d7 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:38:48.433661 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-643743a8-a70e-48ee-8bb5-df78a5d514d7 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:38:48.441881 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-643743a8-a70e-48ee-8bb5-df78a5d514d7 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:38:48.443354 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-643743a8-a70e-48ee-8bb5-df78a5d514d7 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:38:48.444549 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-643743a8-a70e-48ee-8bb5-df78a5d514d7 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] 10.222.0.33 "GET /compute/v2.1/servers/7c4da4be-98d3-4976-97aa-a3ca9b8ddf96" status: 200 len: 1731 microversion: 2.20 time: 0.162440 Jul 18 10:38:48.445342 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 526/1046] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jul 18 10:38:48 2022] GET /compute/v2.1/servers/7c4da4be-98d3-4976-97aa-a3ca9b8ddf96 => generated 1731 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:38:49.463414 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-6bfe04d5-2750-416c-86dd-6a5ce8b1c33d tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:38:49.464040 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-6bfe04d5-2750-416c-86dd-6a5ce8b1c33d tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] [instance: 7c4da4be-98d3-4976-97aa-a3ca9b8ddf96] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:38:49.470738 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-6bfe04d5-2750-416c-86dd-6a5ce8b1c33d tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:38:49.471211 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-6bfe04d5-2750-416c-86dd-6a5ce8b1c33d tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:38:49.471984 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-6bfe04d5-2750-416c-86dd-6a5ce8b1c33d tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:38:49.472415 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-6bfe04d5-2750-416c-86dd-6a5ce8b1c33d tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:38:49.615349 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-6bfe04d5-2750-416c-86dd-6a5ce8b1c33d tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:38:49.623841 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-6bfe04d5-2750-416c-86dd-6a5ce8b1c33d tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:38:49.625306 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-6bfe04d5-2750-416c-86dd-6a5ce8b1c33d tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:38:49.626471 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-6bfe04d5-2750-416c-86dd-6a5ce8b1c33d tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] 10.222.0.33 "GET /compute/v2.1/servers/7c4da4be-98d3-4976-97aa-a3ca9b8ddf96" status: 200 len: 1731 microversion: 2.20 time: 0.166997 Jul 18 10:38:49.627234 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 521/1047] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jul 18 10:38:49 2022] GET /compute/v2.1/servers/7c4da4be-98d3-4976-97aa-a3ca9b8ddf96 => generated 1731 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:38:50.646165 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-d4a5ca8c-7f5d-4ecf-ae29-098e1d80fc4f tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:38:50.647063 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-d4a5ca8c-7f5d-4ecf-ae29-098e1d80fc4f tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] [instance: 7c4da4be-98d3-4976-97aa-a3ca9b8ddf96] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:38:50.654355 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-d4a5ca8c-7f5d-4ecf-ae29-098e1d80fc4f tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:38:50.654891 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-d4a5ca8c-7f5d-4ecf-ae29-098e1d80fc4f tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:38:50.655751 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-d4a5ca8c-7f5d-4ecf-ae29-098e1d80fc4f tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:38:50.656253 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-d4a5ca8c-7f5d-4ecf-ae29-098e1d80fc4f tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:38:50.792072 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-d4a5ca8c-7f5d-4ecf-ae29-098e1d80fc4f tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:38:50.800873 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-d4a5ca8c-7f5d-4ecf-ae29-098e1d80fc4f tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:38:50.803150 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-d4a5ca8c-7f5d-4ecf-ae29-098e1d80fc4f tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:38:50.804331 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-d4a5ca8c-7f5d-4ecf-ae29-098e1d80fc4f tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] 10.222.0.33 "GET /compute/v2.1/servers/7c4da4be-98d3-4976-97aa-a3ca9b8ddf96" status: 200 len: 1731 microversion: 2.20 time: 0.163190 Jul 18 10:38:50.815142 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 527/1048] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jul 18 10:38:50 2022] GET /compute/v2.1/servers/7c4da4be-98d3-4976-97aa-a3ca9b8ddf96 => generated 1731 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:38:51.826007 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-2af40f89-70b1-46bc-90d7-1be46244c537 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:38:51.827394 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-2af40f89-70b1-46bc-90d7-1be46244c537 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] [instance: 7c4da4be-98d3-4976-97aa-a3ca9b8ddf96] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:38:51.835066 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-2af40f89-70b1-46bc-90d7-1be46244c537 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:38:51.835848 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-2af40f89-70b1-46bc-90d7-1be46244c537 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:38:51.836882 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-2af40f89-70b1-46bc-90d7-1be46244c537 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:38:51.837519 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-2af40f89-70b1-46bc-90d7-1be46244c537 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:38:51.977731 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-2af40f89-70b1-46bc-90d7-1be46244c537 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:38:51.987371 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-2af40f89-70b1-46bc-90d7-1be46244c537 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:38:51.988930 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-2af40f89-70b1-46bc-90d7-1be46244c537 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:38:51.990089 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-2af40f89-70b1-46bc-90d7-1be46244c537 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] 10.222.0.33 "GET /compute/v2.1/servers/7c4da4be-98d3-4976-97aa-a3ca9b8ddf96" status: 200 len: 1731 microversion: 2.20 time: 0.167991 Jul 18 10:38:51.990650 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 522/1049] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jul 18 10:38:51 2022] GET /compute/v2.1/servers/7c4da4be-98d3-4976-97aa-a3ca9b8ddf96 => generated 1731 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:38:53.008794 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-4dbfa003-4e2e-4b4c-8e28-f6f0191551c1 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:38:53.009455 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-4dbfa003-4e2e-4b4c-8e28-f6f0191551c1 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] [instance: 7c4da4be-98d3-4976-97aa-a3ca9b8ddf96] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:38:53.015967 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-4dbfa003-4e2e-4b4c-8e28-f6f0191551c1 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:38:53.016424 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-4dbfa003-4e2e-4b4c-8e28-f6f0191551c1 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:38:53.017218 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-4dbfa003-4e2e-4b4c-8e28-f6f0191551c1 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:38:53.017660 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-4dbfa003-4e2e-4b4c-8e28-f6f0191551c1 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:38:53.146912 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-4dbfa003-4e2e-4b4c-8e28-f6f0191551c1 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:38:53.155356 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-4dbfa003-4e2e-4b4c-8e28-f6f0191551c1 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:38:53.156893 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-4dbfa003-4e2e-4b4c-8e28-f6f0191551c1 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:38:53.158064 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-4dbfa003-4e2e-4b4c-8e28-f6f0191551c1 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] 10.222.0.33 "GET /compute/v2.1/servers/7c4da4be-98d3-4976-97aa-a3ca9b8ddf96" status: 200 len: 1731 microversion: 2.20 time: 0.153192 Jul 18 10:38:53.158625 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 528/1050] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jul 18 10:38:53 2022] GET /compute/v2.1/servers/7c4da4be-98d3-4976-97aa-a3ca9b8ddf96 => generated 1731 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:38:54.176897 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-db1148c9-ea5b-4145-893f-e93669bdd03e tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:38:54.177500 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-db1148c9-ea5b-4145-893f-e93669bdd03e tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] [instance: 7c4da4be-98d3-4976-97aa-a3ca9b8ddf96] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:38:54.184685 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-db1148c9-ea5b-4145-893f-e93669bdd03e tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:38:54.185133 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-db1148c9-ea5b-4145-893f-e93669bdd03e tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:38:54.185898 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-db1148c9-ea5b-4145-893f-e93669bdd03e tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:38:54.186327 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-db1148c9-ea5b-4145-893f-e93669bdd03e tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:38:54.486896 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-db1148c9-ea5b-4145-893f-e93669bdd03e tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:38:54.494800 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-db1148c9-ea5b-4145-893f-e93669bdd03e tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:38:54.496282 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-db1148c9-ea5b-4145-893f-e93669bdd03e tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:38:54.497445 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-db1148c9-ea5b-4145-893f-e93669bdd03e tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] 10.222.0.33 "GET /compute/v2.1/servers/7c4da4be-98d3-4976-97aa-a3ca9b8ddf96" status: 200 len: 1731 microversion: 2.20 time: 0.324424 Jul 18 10:38:54.497997 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 523/1051] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jul 18 10:38:54 2022] GET /compute/v2.1/servers/7c4da4be-98d3-4976-97aa-a3ca9b8ddf96 => generated 1731 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:38:55.515773 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-969caf3a-8bc8-469a-9a3d-b85a17cf5206 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:38:55.516386 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-969caf3a-8bc8-469a-9a3d-b85a17cf5206 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] [instance: 7c4da4be-98d3-4976-97aa-a3ca9b8ddf96] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:38:55.522885 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-969caf3a-8bc8-469a-9a3d-b85a17cf5206 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:38:55.523348 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-969caf3a-8bc8-469a-9a3d-b85a17cf5206 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:38:55.524124 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-969caf3a-8bc8-469a-9a3d-b85a17cf5206 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:38:55.524603 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-969caf3a-8bc8-469a-9a3d-b85a17cf5206 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:38:55.966776 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-969caf3a-8bc8-469a-9a3d-b85a17cf5206 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:38:55.974528 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-969caf3a-8bc8-469a-9a3d-b85a17cf5206 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:38:55.976282 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-969caf3a-8bc8-469a-9a3d-b85a17cf5206 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:38:55.977509 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-969caf3a-8bc8-469a-9a3d-b85a17cf5206 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] 10.222.0.33 "GET /compute/v2.1/servers/7c4da4be-98d3-4976-97aa-a3ca9b8ddf96" status: 200 len: 1731 microversion: 2.20 time: 0.466187 Jul 18 10:38:55.978087 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 529/1052] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jul 18 10:38:55 2022] GET /compute/v2.1/servers/7c4da4be-98d3-4976-97aa-a3ca9b8ddf96 => generated 1731 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:38:56.995370 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-778af863-2a06-4e01-b1d3-af2c7762071a tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:38:56.995978 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-778af863-2a06-4e01-b1d3-af2c7762071a tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] [instance: 7c4da4be-98d3-4976-97aa-a3ca9b8ddf96] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:38:57.002908 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-778af863-2a06-4e01-b1d3-af2c7762071a tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:38:57.003355 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-778af863-2a06-4e01-b1d3-af2c7762071a tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:38:57.004124 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-778af863-2a06-4e01-b1d3-af2c7762071a tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:38:57.004775 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-778af863-2a06-4e01-b1d3-af2c7762071a tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:38:57.020581 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG dbcounter [-] [117880] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=117880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:38:57.140442 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-778af863-2a06-4e01-b1d3-af2c7762071a tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:38:57.148317 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-778af863-2a06-4e01-b1d3-af2c7762071a tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:38:57.149872 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-778af863-2a06-4e01-b1d3-af2c7762071a tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:38:57.151066 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-778af863-2a06-4e01-b1d3-af2c7762071a tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] 10.222.0.33 "GET /compute/v2.1/servers/7c4da4be-98d3-4976-97aa-a3ca9b8ddf96" status: 200 len: 1731 microversion: 2.20 time: 0.159687 Jul 18 10:38:57.151616 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 524/1053] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jul 18 10:38:56 2022] GET /compute/v2.1/servers/7c4da4be-98d3-4976-97aa-a3ca9b8ddf96 => generated 1731 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:38:58.169919 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-08c6703a-f720-445c-914c-80c5cae66ef1 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:38:58.170522 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-08c6703a-f720-445c-914c-80c5cae66ef1 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] [instance: 7c4da4be-98d3-4976-97aa-a3ca9b8ddf96] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:38:58.177014 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-08c6703a-f720-445c-914c-80c5cae66ef1 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:38:58.177462 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-08c6703a-f720-445c-914c-80c5cae66ef1 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:38:58.178219 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-08c6703a-f720-445c-914c-80c5cae66ef1 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:38:58.178650 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-08c6703a-f720-445c-914c-80c5cae66ef1 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:38:58.306390 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-08c6703a-f720-445c-914c-80c5cae66ef1 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:38:58.314193 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-08c6703a-f720-445c-914c-80c5cae66ef1 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:38:58.315692 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-08c6703a-f720-445c-914c-80c5cae66ef1 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:38:58.316869 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-08c6703a-f720-445c-914c-80c5cae66ef1 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] 10.222.0.33 "GET /compute/v2.1/servers/7c4da4be-98d3-4976-97aa-a3ca9b8ddf96" status: 200 len: 1731 microversion: 2.20 time: 0.151420 Jul 18 10:38:58.317417 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 530/1054] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jul 18 10:38:58 2022] GET /compute/v2.1/servers/7c4da4be-98d3-4976-97aa-a3ca9b8ddf96 => generated 1731 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:38:59.031596 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [req-e731f772-739e-4aa2-af41-64e9fca35926 req-cd9e2aa3-7fd0-4b22-8af9-b7400e329dcc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c4da4be-98d3-4976-97aa-a3ca9b8ddf96", "name": "network-vif-plugged", "status": "completed", "tag": "1dcc8a67-356a-4505-8579-9742b691b360"}]} {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:38:59.040567 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [req-e731f772-739e-4aa2-af41-64e9fca35926 req-cd9e2aa3-7fd0-4b22-8af9-b7400e329dcc service nova] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:38:59.041633 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [req-e731f772-739e-4aa2-af41-64e9fca35926 req-cd9e2aa3-7fd0-4b22-8af9-b7400e329dcc service nova] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:38:59.053720 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.compute.server_external_events [req-e731f772-739e-4aa2-af41-64e9fca35926 req-cd9e2aa3-7fd0-4b22-8af9-b7400e329dcc service nova] Creating event network-vif-plugged:1dcc8a67-356a-4505-8579-9742b691b360 for instance 7c4da4be-98d3-4976-97aa-a3ca9b8ddf96 on hv-cinder-83754 Jul 18 10:38:59.058720 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [req-e731f772-739e-4aa2-af41-64e9fca35926 req-cd9e2aa3-7fd0-4b22-8af9-b7400e329dcc service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031234 Jul 18 10:38:59.059341 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 525/1055] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jul 18 10:38:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 10:38:59.334695 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-9a06c395-61c7-44b8-ac3c-d9ca18ac7db3 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:38:59.335303 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-9a06c395-61c7-44b8-ac3c-d9ca18ac7db3 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] [instance: 7c4da4be-98d3-4976-97aa-a3ca9b8ddf96] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:38:59.342424 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-9a06c395-61c7-44b8-ac3c-d9ca18ac7db3 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:38:59.342881 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-9a06c395-61c7-44b8-ac3c-d9ca18ac7db3 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:38:59.343649 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-9a06c395-61c7-44b8-ac3c-d9ca18ac7db3 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:38:59.344090 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-9a06c395-61c7-44b8-ac3c-d9ca18ac7db3 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:38:59.469785 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-9a06c395-61c7-44b8-ac3c-d9ca18ac7db3 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:38:59.477930 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-9a06c395-61c7-44b8-ac3c-d9ca18ac7db3 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:38:59.479441 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-9a06c395-61c7-44b8-ac3c-d9ca18ac7db3 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:38:59.480626 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-9a06c395-61c7-44b8-ac3c-d9ca18ac7db3 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] 10.222.0.33 "GET /compute/v2.1/servers/7c4da4be-98d3-4976-97aa-a3ca9b8ddf96" status: 200 len: 1731 microversion: 2.20 time: 0.149795 Jul 18 10:38:59.481186 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 531/1056] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jul 18 10:38:59 2022] GET /compute/v2.1/servers/7c4da4be-98d3-4976-97aa-a3ca9b8ddf96 => generated 1731 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:39:00.498675 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-5807caf4-f298-46e8-8894-a614eb787e8c tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:39:00.499275 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-5807caf4-f298-46e8-8894-a614eb787e8c tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] [instance: 7c4da4be-98d3-4976-97aa-a3ca9b8ddf96] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:39:00.501237 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG dbcounter [-] [117880] Writing DB stats nova_api:SELECT=34 {{(pid=117880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:39:00.507116 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-5807caf4-f298-46e8-8894-a614eb787e8c tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:39:00.507565 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-5807caf4-f298-46e8-8894-a614eb787e8c tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:39:00.509870 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-5807caf4-f298-46e8-8894-a614eb787e8c tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:39:00.509870 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-5807caf4-f298-46e8-8894-a614eb787e8c tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:39:00.640590 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-5807caf4-f298-46e8-8894-a614eb787e8c tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:39:00.648355 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-5807caf4-f298-46e8-8894-a614eb787e8c tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:39:00.649847 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-5807caf4-f298-46e8-8894-a614eb787e8c tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:39:00.650977 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-5807caf4-f298-46e8-8894-a614eb787e8c tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] 10.222.0.33 "GET /compute/v2.1/servers/7c4da4be-98d3-4976-97aa-a3ca9b8ddf96" status: 200 len: 1731 microversion: 2.20 time: 0.157159 Jul 18 10:39:00.651528 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 526/1057] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jul 18 10:39:00 2022] GET /compute/v2.1/servers/7c4da4be-98d3-4976-97aa-a3ca9b8ddf96 => generated 1731 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:39:01.670070 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-9ca686b1-6b0f-43cd-93a3-6708d76e4b00 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:39:01.670849 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-9ca686b1-6b0f-43cd-93a3-6708d76e4b00 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] [instance: 7c4da4be-98d3-4976-97aa-a3ca9b8ddf96] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:39:01.673171 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG dbcounter [-] [117879] Writing DB stats nova_api:SELECT=32 {{(pid=117879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:39:01.678449 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-9ca686b1-6b0f-43cd-93a3-6708d76e4b00 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:39:01.678916 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-9ca686b1-6b0f-43cd-93a3-6708d76e4b00 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:39:01.679697 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-9ca686b1-6b0f-43cd-93a3-6708d76e4b00 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:39:01.680143 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-9ca686b1-6b0f-43cd-93a3-6708d76e4b00 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:39:01.813687 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-9ca686b1-6b0f-43cd-93a3-6708d76e4b00 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:39:01.821570 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-9ca686b1-6b0f-43cd-93a3-6708d76e4b00 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:39:01.823078 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-9ca686b1-6b0f-43cd-93a3-6708d76e4b00 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:39:01.824234 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-9ca686b1-6b0f-43cd-93a3-6708d76e4b00 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] 10.222.0.33 "GET /compute/v2.1/servers/7c4da4be-98d3-4976-97aa-a3ca9b8ddf96" status: 200 len: 1718 microversion: 2.20 time: 0.158741 Jul 18 10:39:01.824833 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 532/1058] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jul 18 10:39:01 2022] GET /compute/v2.1/servers/7c4da4be-98d3-4976-97aa-a3ca9b8ddf96 => generated 1718 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:39:17.526302 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-62306f54-4d9a-4535-b663-d42d822ab9a4 tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:39:17.526824 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-62306f54-4d9a-4535-b663-d42d822ab9a4 tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] [instance: 00da9ad2-aef2-4a2b-8ae8-51ee9e41e049] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:39:17.529588 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG dbcounter [-] [117880] Writing DB stats nova_api:SELECT=1 {{(pid=117880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:39:17.535146 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [req-667c4b3a-2498-4408-9ab4-998af87fd337 req-fa4b1aaf-41d7-4ef6-92f5-e2a8bbed3e9d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "00da9ad2-aef2-4a2b-8ae8-51ee9e41e049", "tag": "01aa80e4-4901-4d77-80cb-a644fd1ee6ff"}]} {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:39:17.538919 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG dbcounter [-] [117879] Writing DB stats nova_api:SELECT=1 {{(pid=117879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:39:17.540208 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG dbcounter [-] [117880] Writing DB stats nova_cell1:SELECT=11 {{(pid=117880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:39:17.541047 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG dbcounter [-] [117879] Writing DB stats nova_cell1:SELECT=70,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=117879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:39:17.547412 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [req-667c4b3a-2498-4408-9ab4-998af87fd337 req-fa4b1aaf-41d7-4ef6-92f5-e2a8bbed3e9d service nova] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:39:17.547859 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [req-667c4b3a-2498-4408-9ab4-998af87fd337 req-fa4b1aaf-41d7-4ef6-92f5-e2a8bbed3e9d service nova] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:39:17.557404 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-62306f54-4d9a-4535-b663-d42d822ab9a4 tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:39:17.557854 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-62306f54-4d9a-4535-b663-d42d822ab9a4 tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:39:17.558628 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-62306f54-4d9a-4535-b663-d42d822ab9a4 tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:39:17.559074 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-62306f54-4d9a-4535-b663-d42d822ab9a4 tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:39:17.566687 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.compute.server_external_events [req-667c4b3a-2498-4408-9ab4-998af87fd337 req-fa4b1aaf-41d7-4ef6-92f5-e2a8bbed3e9d service nova] Creating event network-changed:01aa80e4-4901-4d77-80cb-a644fd1ee6ff for instance 00da9ad2-aef2-4a2b-8ae8-51ee9e41e049 on hv-cinder-83754 Jul 18 10:39:17.572216 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [req-667c4b3a-2498-4408-9ab4-998af87fd337 req-fa4b1aaf-41d7-4ef6-92f5-e2a8bbed3e9d service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040722 Jul 18 10:39:17.573044 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 533/1059] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jul 18 10:39:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:39:17.585309 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-62306f54-4d9a-4535-b663-d42d822ab9a4 tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] [instance: 00da9ad2-aef2-4a2b-8ae8-51ee9e41e049] Going to try to terminate instance {{(pid=117880) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 10:39:17.671940 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-62306f54-4d9a-4535-b663-d42d822ab9a4 tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] 10.222.0.33 "DELETE /compute/v2.1/servers/00da9ad2-aef2-4a2b-8ae8-51ee9e41e049" status: 204 len: 0 microversion: 2.1 time: 0.149330 Jul 18 10:39:17.672540 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 527/1060] 10.222.0.33 () {58 vars in 1238 bytes} [Mon Jul 18 10:39:17 2022] DELETE /compute/v2.1/servers/00da9ad2-aef2-4a2b-8ae8-51ee9e41e049 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 10:39:17.681314 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-08923678-c471-44e3-b830-a330602cf140 tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:39:17.682153 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-08923678-c471-44e3-b830-a330602cf140 tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] [instance: 00da9ad2-aef2-4a2b-8ae8-51ee9e41e049] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:39:17.689555 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-08923678-c471-44e3-b830-a330602cf140 tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:39:17.689969 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-08923678-c471-44e3-b830-a330602cf140 tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:39:17.690956 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-08923678-c471-44e3-b830-a330602cf140 tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:39:17.691389 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-08923678-c471-44e3-b830-a330602cf140 tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:39:17.863893 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-08923678-c471-44e3-b830-a330602cf140 tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de7190c1ae524da280700ef2548a4a17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5628452a1ceb4af293ea96c187983fa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:39:17.871473 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-08923678-c471-44e3-b830-a330602cf140 tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] 10.222.0.33 "GET /compute/v2.1/servers/00da9ad2-aef2-4a2b-8ae8-51ee9e41e049" status: 200 len: 1568 microversion: 2.1 time: 0.194581 Jul 18 10:39:17.872645 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 534/1061] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:39:17 2022] GET /compute/v2.1/servers/00da9ad2-aef2-4a2b-8ae8-51ee9e41e049 => generated 1568 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:39:18.890738 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-54059479-a55d-4377-bfe2-dee1b1efb0ad tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:39:18.891460 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-54059479-a55d-4377-bfe2-dee1b1efb0ad tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] [instance: 00da9ad2-aef2-4a2b-8ae8-51ee9e41e049] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:39:18.901129 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-54059479-a55d-4377-bfe2-dee1b1efb0ad tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:39:18.901572 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-54059479-a55d-4377-bfe2-dee1b1efb0ad tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:39:18.902350 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-54059479-a55d-4377-bfe2-dee1b1efb0ad tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:39:18.902784 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-54059479-a55d-4377-bfe2-dee1b1efb0ad tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:39:19.069724 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-54059479-a55d-4377-bfe2-dee1b1efb0ad tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de7190c1ae524da280700ef2548a4a17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5628452a1ceb4af293ea96c187983fa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:39:19.077868 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-54059479-a55d-4377-bfe2-dee1b1efb0ad tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] 10.222.0.33 "GET /compute/v2.1/servers/00da9ad2-aef2-4a2b-8ae8-51ee9e41e049" status: 200 len: 1568 microversion: 2.1 time: 0.192090 Jul 18 10:39:19.078432 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 528/1062] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:39:18 2022] GET /compute/v2.1/servers/00da9ad2-aef2-4a2b-8ae8-51ee9e41e049 => generated 1568 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:39:19.927514 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [req-2ed013d2-ff36-4e25-a245-6b49192ae948 req-c6c559b5-d8b6-4ee8-8365-d6cb3550016f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "00da9ad2-aef2-4a2b-8ae8-51ee9e41e049", "name": "network-vif-deleted", "tag": "01aa80e4-4901-4d77-80cb-a644fd1ee6ff"}]} {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:39:19.937336 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [req-2ed013d2-ff36-4e25-a245-6b49192ae948 req-c6c559b5-d8b6-4ee8-8365-d6cb3550016f service nova] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:39:19.937876 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [req-2ed013d2-ff36-4e25-a245-6b49192ae948 req-c6c559b5-d8b6-4ee8-8365-d6cb3550016f service nova] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:39:19.949680 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.compute.server_external_events [req-2ed013d2-ff36-4e25-a245-6b49192ae948 req-c6c559b5-d8b6-4ee8-8365-d6cb3550016f service nova] Creating event network-vif-deleted:01aa80e4-4901-4d77-80cb-a644fd1ee6ff for instance 00da9ad2-aef2-4a2b-8ae8-51ee9e41e049 on hv-cinder-83754 Jul 18 10:39:19.954927 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [req-2ed013d2-ff36-4e25-a245-6b49192ae948 req-c6c559b5-d8b6-4ee8-8365-d6cb3550016f service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031474 Jul 18 10:39:19.955465 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 535/1063] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jul 18 10:39:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:39:20.095764 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-5b6ede62-1c72-414e-bf3f-3d2768d15b9f tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:39:20.096375 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-5b6ede62-1c72-414e-bf3f-3d2768d15b9f tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] [instance: 00da9ad2-aef2-4a2b-8ae8-51ee9e41e049] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:39:20.103152 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-5b6ede62-1c72-414e-bf3f-3d2768d15b9f tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:39:20.103602 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-5b6ede62-1c72-414e-bf3f-3d2768d15b9f tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:39:20.104367 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-5b6ede62-1c72-414e-bf3f-3d2768d15b9f tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:39:20.104827 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-5b6ede62-1c72-414e-bf3f-3d2768d15b9f tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:39:20.168873 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-5b6ede62-1c72-414e-bf3f-3d2768d15b9f tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de7190c1ae524da280700ef2548a4a17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5628452a1ceb4af293ea96c187983fa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:39:20.179205 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-5b6ede62-1c72-414e-bf3f-3d2768d15b9f tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] 10.222.0.33 "GET /compute/v2.1/servers/00da9ad2-aef2-4a2b-8ae8-51ee9e41e049" status: 200 len: 1219 microversion: 2.1 time: 0.085210 Jul 18 10:39:20.179205 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 529/1064] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:39:20 2022] GET /compute/v2.1/servers/00da9ad2-aef2-4a2b-8ae8-51ee9e41e049 => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:39:21.195597 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-de6dabab-5c00-44bf-8acf-6bb31598e65f tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:39:21.196400 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-de6dabab-5c00-44bf-8acf-6bb31598e65f tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] [instance: 00da9ad2-aef2-4a2b-8ae8-51ee9e41e049] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:39:21.203063 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-de6dabab-5c00-44bf-8acf-6bb31598e65f tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:39:21.203514 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-de6dabab-5c00-44bf-8acf-6bb31598e65f tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:39:21.204278 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-de6dabab-5c00-44bf-8acf-6bb31598e65f tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:39:21.204744 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-de6dabab-5c00-44bf-8acf-6bb31598e65f tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:39:21.218143 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.wsgi [None req-de6dabab-5c00-44bf-8acf-6bb31598e65f tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] HTTP exception thrown: Instance 00da9ad2-aef2-4a2b-8ae8-51ee9e41e049 could not be found. Jul 18 10:39:21.219748 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-de6dabab-5c00-44bf-8acf-6bb31598e65f tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] Request method failure captured: Jul 18 10:39:21.219748 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: request: GET /compute/v2.1/servers/00da9ad2-aef2-4a2b-8ae8-51ee9e41e049 HTTP/1.1 Jul 18 10:39:21.219748 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: Accept: application/json Jul 18 10:39:21.219748 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: Accept-Encoding: identity Jul 18 10:39:21.219748 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: Connection: close Jul 18 10:39:21.219748 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: Content-Length: 0 Jul 18 10:39:21.219748 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: Content-Type: application/json Jul 18 10:39:21.219748 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: Host: 10.222.0.33 Jul 18 10:39:21.219748 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: Openstack-System-Scope: None Jul 18 10:39:21.219748 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: User-Agent: python-urllib3/1.26.9 Jul 18 10:39:21.219748 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Auth-Token: gAAAAABi1TdASkjYf5TcEy3l1Fr69LXFlY6dhkprQdTenpZDwSHshNBwg6AmSjOzINVhIHJCT1hO5RN8lUwFh84FDFkO308oiE60eoABkWG-UtoT0OwTAGwMA7F8glUGhCnXyvN6KeH_aA2cfDdDbeOSLYhcp5C6rihlt5krvK42w6a_m99gx4k Jul 18 10:39:21.219748 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Domain-Id: None Jul 18 10:39:21.219748 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Domain-Name: None Jul 18 10:39:21.219748 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Identity-Status: Confirmed Jul 18 10:39:21.219748 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Is-Admin-Project: True Jul 18 10:39:21.219748 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Project-Domain-Id: default Jul 18 10:39:21.219748 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Project-Domain-Name: Default Jul 18 10:39:21.219748 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Project-Id: 5628452a1ceb4af293ea96c187983fa6 Jul 18 10:39:21.219748 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Project-Name: tempest-TestShelveInstance-640178012 Jul 18 10:39:21.219748 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Role: member,reader Jul 18 10:39:21.219748 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Roles: member,reader Jul 18 10:39:21.221525 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5628452a1ceb4af293ea96c187983fa6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5628452a1ceb4af293ea96c187983fa6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/5628452a1ceb4af293ea96c187983fa6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_5628452a1ceb4af293ea96c187983fa6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jul 18 10:39:21.221525 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Tenant: tempest-TestShelveInstance-640178012 Jul 18 10:39:21.221525 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Tenant-Id: 5628452a1ceb4af293ea96c187983fa6 Jul 18 10:39:21.221525 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Tenant-Name: tempest-TestShelveInstance-640178012 Jul 18 10:39:21.221525 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-User: tempest-TestShelveInstance-640178012-project Jul 18 10:39:21.221525 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-User-Domain-Id: default Jul 18 10:39:21.221525 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-User-Domain-Name: Default Jul 18 10:39:21.221525 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-User-Id: de7190c1ae524da280700ef2548a4a17 Jul 18 10:39:21.221525 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-User-Name: tempest-TestShelveInstance-640178012-project Jul 18 10:39:21.221525 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: method: > Jul 18 10:39:21.221525 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: exception: Instance 00da9ad2-aef2-4a2b-8ae8-51ee9e41e049 could not be found. Jul 18 10:39:21.221525 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: action_args: {'id': '00da9ad2-aef2-4a2b-8ae8-51ee9e41e049'} Jul 18 10:39:21.222403 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 10:39:21.222403 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:39:21.222403 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 10:39:21.222403 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 10:39:21.222403 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 10:39:21.222403 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 10:39:21.222403 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 10:39:21.222403 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 10:39:21.222403 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 10:39:21.222403 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 10:39:21.222403 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 00da9ad2-aef2-4a2b-8ae8-51ee9e41e049 could not be found. Jul 18 10:39:21.222403 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi Jul 18 10:39:21.222403 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:39:21.222403 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi Jul 18 10:39:21.222403 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:39:21.222403 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:39:21.222403 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:39:21.222403 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 10:39:21.222403 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 10:39:21.222403 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 10:39:21.224727 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 10:39:21.224727 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 10:39:21.224727 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 10:39:21.224727 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 10:39:21.224727 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 10:39:21.224727 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 10:39:21.224727 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 10:39:21.224727 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 00da9ad2-aef2-4a2b-8ae8-51ee9e41e049 could not be found. Jul 18 10:39:21.224727 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi Jul 18 10:39:21.224727 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:39:21.224727 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi Jul 18 10:39:21.224727 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:39:21.224727 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:39:21.224727 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:39:21.224727 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 10:39:21.224727 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 10:39:21.224727 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 00da9ad2-aef2-4a2b-8ae8-51ee9e41e049 could not be found. Jul 18 10:39:21.224727 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi Jul 18 10:39:21.227378 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-de6dabab-5c00-44bf-8acf-6bb31598e65f tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] Returning 404 to user: Instance 00da9ad2-aef2-4a2b-8ae8-51ee9e41e049 could not be found. {{(pid=117879) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 10:39:21.227378 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-de6dabab-5c00-44bf-8acf-6bb31598e65f tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] 10.222.0.33 "GET /compute/v2.1/servers/00da9ad2-aef2-4a2b-8ae8-51ee9e41e049" status: 404 len: 111 microversion: 2.1 time: 0.030416 Jul 18 10:39:21.227378 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 536/1065] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:39:21 2022] GET /compute/v2.1/servers/00da9ad2-aef2-4a2b-8ae8-51ee9e41e049 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 10:39:21.385106 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-a905f3d1-ffd9-42ce-9061-d187d040f199 tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] Calling method '.version_select at 0x7f9f49f58670>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:39:21.405893 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-a905f3d1-ffd9-42ce-9061-d187d040f199 tempest-TestShelveInstance-640178012 tempest-TestShelveInstance-640178012-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1837206712" status: 202 len: 0 microversion: 2.1 time: 0.024356 Jul 18 10:39:21.406530 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 530/1066] 10.222.0.33 () {58 vars in 1253 bytes} [Mon Jul 18 10:39:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1837206712 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 10:39:35.033100 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-efcedd81-3b52-46de-a86d-67dce4cf1624 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:39:35.034012 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-efcedd81-3b52-46de-a86d-67dce4cf1624 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] [instance: 7c4da4be-98d3-4976-97aa-a3ca9b8ddf96] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:39:35.036490 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG dbcounter [-] [117879] Writing DB stats nova_api:SELECT=8 {{(pid=117879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:39:35.037243 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG dbcounter [-] [117879] Writing DB stats nova_cell1:SELECT=12 {{(pid=117879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:39:35.043003 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-efcedd81-3b52-46de-a86d-67dce4cf1624 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:39:35.043448 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-efcedd81-3b52-46de-a86d-67dce4cf1624 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:39:35.044208 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-efcedd81-3b52-46de-a86d-67dce4cf1624 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:39:35.044683 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-efcedd81-3b52-46de-a86d-67dce4cf1624 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:39:35.073313 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-efcedd81-3b52-46de-a86d-67dce4cf1624 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] 10.222.0.33 "GET /compute/v2.1/servers/7c4da4be-98d3-4976-97aa-a3ca9b8ddf96/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.043997 Jul 18 10:39:35.073812 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 537/1067] 10.222.0.33 () {60 vars in 1342 bytes} [Mon Jul 18 10:39:35 2022] GET /compute/v2.1/servers/7c4da4be-98d3-4976-97aa-a3ca9b8ddf96/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:39:35.134235 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-9955f873-31b0-4180-9ac8-7faa9cddf9ac tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:39:35.134770 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-9955f873-31b0-4180-9ac8-7faa9cddf9ac tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] [instance: 7c4da4be-98d3-4976-97aa-a3ca9b8ddf96] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:39:35.138661 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG dbcounter [-] [117880] Writing DB stats nova_cell1:SELECT=26,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:39:35.139305 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG dbcounter [-] [117880] Writing DB stats nova_api:SELECT=14,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:39:35.146259 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-9955f873-31b0-4180-9ac8-7faa9cddf9ac tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:39:35.146717 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-9955f873-31b0-4180-9ac8-7faa9cddf9ac tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:39:35.147475 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-9955f873-31b0-4180-9ac8-7faa9cddf9ac tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:39:35.147904 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-9955f873-31b0-4180-9ac8-7faa9cddf9ac tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:39:35.175617 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-9955f873-31b0-4180-9ac8-7faa9cddf9ac tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] [instance: 7c4da4be-98d3-4976-97aa-a3ca9b8ddf96] Going to try to terminate instance {{(pid=117880) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 10:39:35.250930 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-9955f873-31b0-4180-9ac8-7faa9cddf9ac tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] 10.222.0.33 "DELETE /compute/v2.1/servers/7c4da4be-98d3-4976-97aa-a3ca9b8ddf96" status: 204 len: 0 microversion: 2.20 time: 0.120297 Jul 18 10:39:35.251508 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 531/1068] 10.222.0.33 () {60 vars in 1279 bytes} [Mon Jul 18 10:39:35 2022] DELETE /compute/v2.1/servers/7c4da4be-98d3-4976-97aa-a3ca9b8ddf96 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 18 10:39:35.260597 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-67f73e2b-678d-4ca3-941d-6ee9c647ac5b tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:39:35.261242 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-67f73e2b-678d-4ca3-941d-6ee9c647ac5b tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] [instance: 7c4da4be-98d3-4976-97aa-a3ca9b8ddf96] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:39:35.267370 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-67f73e2b-678d-4ca3-941d-6ee9c647ac5b tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:39:35.267826 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-67f73e2b-678d-4ca3-941d-6ee9c647ac5b tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:39:35.268628 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-67f73e2b-678d-4ca3-941d-6ee9c647ac5b tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:39:35.269069 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-67f73e2b-678d-4ca3-941d-6ee9c647ac5b tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:39:35.407437 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-67f73e2b-678d-4ca3-941d-6ee9c647ac5b tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:39:35.415322 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-67f73e2b-678d-4ca3-941d-6ee9c647ac5b tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:39:35.416888 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-67f73e2b-678d-4ca3-941d-6ee9c647ac5b tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:39:35.418068 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-67f73e2b-678d-4ca3-941d-6ee9c647ac5b tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] 10.222.0.33 "GET /compute/v2.1/servers/7c4da4be-98d3-4976-97aa-a3ca9b8ddf96" status: 200 len: 1724 microversion: 2.20 time: 0.161988 Jul 18 10:39:35.418612 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 538/1069] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jul 18 10:39:35 2022] GET /compute/v2.1/servers/7c4da4be-98d3-4976-97aa-a3ca9b8ddf96 => generated 1724 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:39:36.437737 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-258c1ff4-9724-4b61-bdf5-44a2d37be155 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:39:36.438359 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-258c1ff4-9724-4b61-bdf5-44a2d37be155 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] [instance: 7c4da4be-98d3-4976-97aa-a3ca9b8ddf96] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:39:36.444791 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-258c1ff4-9724-4b61-bdf5-44a2d37be155 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:39:36.445236 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-258c1ff4-9724-4b61-bdf5-44a2d37be155 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:39:36.445996 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-258c1ff4-9724-4b61-bdf5-44a2d37be155 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:39:36.446428 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-258c1ff4-9724-4b61-bdf5-44a2d37be155 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:39:36.577227 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-258c1ff4-9724-4b61-bdf5-44a2d37be155 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:39:36.585050 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-258c1ff4-9724-4b61-bdf5-44a2d37be155 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:39:36.586541 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-258c1ff4-9724-4b61-bdf5-44a2d37be155 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:39:36.587687 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-258c1ff4-9724-4b61-bdf5-44a2d37be155 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] 10.222.0.33 "GET /compute/v2.1/servers/7c4da4be-98d3-4976-97aa-a3ca9b8ddf96" status: 200 len: 1724 microversion: 2.20 time: 0.154813 Jul 18 10:39:36.588243 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 532/1070] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jul 18 10:39:36 2022] GET /compute/v2.1/servers/7c4da4be-98d3-4976-97aa-a3ca9b8ddf96 => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:39:37.606110 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-97a28588-29ac-44e5-973a-6db1b6c05d84 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:39:37.607102 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-97a28588-29ac-44e5-973a-6db1b6c05d84 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] [instance: 7c4da4be-98d3-4976-97aa-a3ca9b8ddf96] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:39:37.618381 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-97a28588-29ac-44e5-973a-6db1b6c05d84 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:39:37.619193 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-97a28588-29ac-44e5-973a-6db1b6c05d84 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:39:37.620207 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-97a28588-29ac-44e5-973a-6db1b6c05d84 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:39:37.621246 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-97a28588-29ac-44e5-973a-6db1b6c05d84 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:39:37.757590 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-97a28588-29ac-44e5-973a-6db1b6c05d84 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:39:37.770079 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-97a28588-29ac-44e5-973a-6db1b6c05d84 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:39:37.771593 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-97a28588-29ac-44e5-973a-6db1b6c05d84 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cacc328f0f3540299310a0e53afe6acb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'feefb94984d54cbbaa70b963d956a520', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:39:37.772796 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-97a28588-29ac-44e5-973a-6db1b6c05d84 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] 10.222.0.33 "GET /compute/v2.1/servers/7c4da4be-98d3-4976-97aa-a3ca9b8ddf96" status: 200 len: 1367 microversion: 2.20 time: 0.171322 Jul 18 10:39:37.773369 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 533/1071] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jul 18 10:39:37 2022] GET /compute/v2.1/servers/7c4da4be-98d3-4976-97aa-a3ca9b8ddf96 => generated 1367 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:39:37.786150 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [req-368ccded-e311-4683-b2ee-c479d7a177d6 req-4e644ab0-75f7-4b37-826d-9c3668b0a4da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c4da4be-98d3-4976-97aa-a3ca9b8ddf96", "name": "network-vif-deleted", "tag": "1dcc8a67-356a-4505-8579-9742b691b360"}]} {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:39:37.796498 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [req-368ccded-e311-4683-b2ee-c479d7a177d6 req-4e644ab0-75f7-4b37-826d-9c3668b0a4da service nova] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:39:37.797076 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [req-368ccded-e311-4683-b2ee-c479d7a177d6 req-4e644ab0-75f7-4b37-826d-9c3668b0a4da service nova] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:39:37.815658 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.compute.server_external_events [req-368ccded-e311-4683-b2ee-c479d7a177d6 req-4e644ab0-75f7-4b37-826d-9c3668b0a4da service nova] Creating event network-vif-deleted:1dcc8a67-356a-4505-8579-9742b691b360 for instance 7c4da4be-98d3-4976-97aa-a3ca9b8ddf96 on hv-cinder-83754 Jul 18 10:39:37.822206 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [req-368ccded-e311-4683-b2ee-c479d7a177d6 req-4e644ab0-75f7-4b37-826d-9c3668b0a4da service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.261663 Jul 18 10:39:37.822945 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 539/1072] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jul 18 10:39:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:39:38.791915 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-eb037dfd-affc-447a-802c-3040ec624ba3 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:39:38.792616 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-eb037dfd-affc-447a-802c-3040ec624ba3 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] [instance: 7c4da4be-98d3-4976-97aa-a3ca9b8ddf96] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:39:38.799678 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-eb037dfd-affc-447a-802c-3040ec624ba3 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:39:38.800127 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-eb037dfd-affc-447a-802c-3040ec624ba3 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:39:38.801017 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-eb037dfd-affc-447a-802c-3040ec624ba3 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:39:38.801456 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-eb037dfd-affc-447a-802c-3040ec624ba3 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:39:38.814718 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.wsgi [None req-eb037dfd-affc-447a-802c-3040ec624ba3 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] HTTP exception thrown: Instance 7c4da4be-98d3-4976-97aa-a3ca9b8ddf96 could not be found. Jul 18 10:39:38.816346 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-eb037dfd-affc-447a-802c-3040ec624ba3 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Request method failure captured: Jul 18 10:39:38.816346 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: request: GET /compute/v2.1/servers/7c4da4be-98d3-4976-97aa-a3ca9b8ddf96 HTTP/1.1 Jul 18 10:39:38.816346 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: Accept: application/json Jul 18 10:39:38.816346 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: Accept-Encoding: identity Jul 18 10:39:38.816346 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: Connection: close Jul 18 10:39:38.816346 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: Content-Length: 0 Jul 18 10:39:38.816346 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: Content-Type: application/json Jul 18 10:39:38.816346 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: Host: 10.222.0.33 Jul 18 10:39:38.816346 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: Openstack-System-Scope: None Jul 18 10:39:38.816346 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: User-Agent: python-urllib3/1.26.9 Jul 18 10:39:38.816346 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Auth-Token: gAAAAABi1TcnBAPlaPHtdv5tIZlRtT0XkCSp1cYOzJpQ75bhg4uyzEacqN1-FLjMcQVoiH0DbKD4MJLRgIlPoR64pKZaLn9i6i8VTsz7xjFqS-WjgWAPUuRVb7FZ5Py6JNNB81cGYGStEleWTuQAnU5tzMZ7b50tk85d9K2dSp0Bw83-FfBykmg Jul 18 10:39:38.816346 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Domain-Id: None Jul 18 10:39:38.816346 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Domain-Name: None Jul 18 10:39:38.816346 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Identity-Status: Confirmed Jul 18 10:39:38.816346 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Is-Admin-Project: True Jul 18 10:39:38.816346 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Openstack-Nova-Api-Version: 2.20 Jul 18 10:39:38.816346 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Project-Domain-Id: default Jul 18 10:39:38.816346 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Project-Domain-Name: Default Jul 18 10:39:38.816346 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Project-Id: feefb94984d54cbbaa70b963d956a520 Jul 18 10:39:38.816346 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-609182469 Jul 18 10:39:38.816346 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Role: member,reader Jul 18 10:39:38.816346 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Roles: member,reader Jul 18 10:39:38.818094 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/feefb94984d54cbbaa70b963d956a520"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/feefb94984d54cbbaa70b963d956a520"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/feefb94984d54cbbaa70b963d956a520"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_feefb94984d54cbbaa70b963d956a520"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jul 18 10:39:38.818094 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Tenant: tempest-AttachVolumeShelveTestJSON-609182469 Jul 18 10:39:38.818094 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Tenant-Id: feefb94984d54cbbaa70b963d956a520 Jul 18 10:39:38.818094 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-609182469 Jul 18 10:39:38.818094 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-User: tempest-AttachVolumeShelveTestJSON-609182469-project Jul 18 10:39:38.818094 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-User-Domain-Id: default Jul 18 10:39:38.818094 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-User-Domain-Name: Default Jul 18 10:39:38.818094 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-User-Id: cacc328f0f3540299310a0e53afe6acb Jul 18 10:39:38.818094 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-User-Name: tempest-AttachVolumeShelveTestJSON-609182469-project Jul 18 10:39:38.818094 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: method: > Jul 18 10:39:38.818094 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: exception: Instance 7c4da4be-98d3-4976-97aa-a3ca9b8ddf96 could not be found. Jul 18 10:39:38.818094 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: action_args: {'id': '7c4da4be-98d3-4976-97aa-a3ca9b8ddf96'} Jul 18 10:39:38.819031 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 10:39:38.819031 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:39:38.819031 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 10:39:38.819031 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 10:39:38.819031 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 10:39:38.819031 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 10:39:38.819031 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 10:39:38.819031 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 10:39:38.819031 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 10:39:38.819031 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 10:39:38.819031 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7c4da4be-98d3-4976-97aa-a3ca9b8ddf96 could not be found. Jul 18 10:39:38.819031 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi Jul 18 10:39:38.819031 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:39:38.819031 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi Jul 18 10:39:38.819031 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:39:38.819031 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:39:38.819031 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:39:38.819031 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 10:39:38.819031 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 10:39:38.819031 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 10:39:38.820613 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 10:39:38.820613 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 10:39:38.820613 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 10:39:38.820613 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 10:39:38.820613 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 10:39:38.820613 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 10:39:38.820613 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 10:39:38.820613 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7c4da4be-98d3-4976-97aa-a3ca9b8ddf96 could not be found. Jul 18 10:39:38.820613 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi Jul 18 10:39:38.820613 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:39:38.820613 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi Jul 18 10:39:38.820613 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:39:38.820613 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:39:38.820613 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:39:38.820613 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 10:39:38.820613 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 10:39:38.820613 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7c4da4be-98d3-4976-97aa-a3ca9b8ddf96 could not be found. Jul 18 10:39:38.820613 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi Jul 18 10:39:38.822216 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-eb037dfd-affc-447a-802c-3040ec624ba3 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Returning 404 to user: Instance 7c4da4be-98d3-4976-97aa-a3ca9b8ddf96 could not be found. {{(pid=117880) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 10:39:38.822216 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-eb037dfd-affc-447a-802c-3040ec624ba3 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] 10.222.0.33 "GET /compute/v2.1/servers/7c4da4be-98d3-4976-97aa-a3ca9b8ddf96" status: 404 len: 111 microversion: 2.20 time: 0.030396 Jul 18 10:39:38.822216 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 534/1073] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jul 18 10:39:38 2022] GET /compute/v2.1/servers/7c4da4be-98d3-4976-97aa-a3ca9b8ddf96 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 18 10:39:38.828047 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-93e186ab-1a79-468f-a9f8-1b0954f501ad tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Calling method '.version_select at 0x7f9f49f42820>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:39:38.846320 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-93e186ab-1a79-468f-a9f8-1b0954f501ad tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2142457572" status: 204 len: 0 microversion: 2.20 time: 0.022758 Jul 18 10:39:38.846878 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 540/1074] 10.222.0.33 () {60 vars in 1261 bytes} [Mon Jul 18 10:39:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2142457572 => generated 0 bytes in 25 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 18 10:39:40.583878 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-5e019450-e8ba-4597-ab23-20de1aa063c8 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:39:40.584370 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-5e019450-e8ba-4597-ab23-20de1aa063c8 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] [instance: 7c4da4be-98d3-4976-97aa-a3ca9b8ddf96] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:39:40.590690 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-5e019450-e8ba-4597-ab23-20de1aa063c8 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:39:40.591134 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-5e019450-e8ba-4597-ab23-20de1aa063c8 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:39:40.591911 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-5e019450-e8ba-4597-ab23-20de1aa063c8 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:39:40.592342 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-5e019450-e8ba-4597-ab23-20de1aa063c8 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:39:40.605562 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.wsgi [None req-5e019450-e8ba-4597-ab23-20de1aa063c8 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] HTTP exception thrown: Instance 7c4da4be-98d3-4976-97aa-a3ca9b8ddf96 could not be found. Jul 18 10:39:40.607591 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-5e019450-e8ba-4597-ab23-20de1aa063c8 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Request method failure captured: Jul 18 10:39:40.607591 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: request: DELETE /compute/v2.1/servers/7c4da4be-98d3-4976-97aa-a3ca9b8ddf96 HTTP/1.1 Jul 18 10:39:40.607591 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: Accept: application/json Jul 18 10:39:40.607591 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: Accept-Encoding: identity Jul 18 10:39:40.607591 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: Connection: close Jul 18 10:39:40.607591 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: Content-Length: 0 Jul 18 10:39:40.607591 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: Content-Type: application/json Jul 18 10:39:40.607591 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: Host: 10.222.0.33 Jul 18 10:39:40.607591 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: Openstack-System-Scope: None Jul 18 10:39:40.607591 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: User-Agent: python-urllib3/1.26.9 Jul 18 10:39:40.607591 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Auth-Token: gAAAAABi1TcnBAPlaPHtdv5tIZlRtT0XkCSp1cYOzJpQ75bhg4uyzEacqN1-FLjMcQVoiH0DbKD4MJLRgIlPoR64pKZaLn9i6i8VTsz7xjFqS-WjgWAPUuRVb7FZ5Py6JNNB81cGYGStEleWTuQAnU5tzMZ7b50tk85d9K2dSp0Bw83-FfBykmg Jul 18 10:39:40.607591 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Domain-Id: None Jul 18 10:39:40.607591 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Domain-Name: None Jul 18 10:39:40.607591 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Identity-Status: Confirmed Jul 18 10:39:40.607591 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Is-Admin-Project: True Jul 18 10:39:40.607591 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Openstack-Nova-Api-Version: 2.20 Jul 18 10:39:40.607591 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Project-Domain-Id: default Jul 18 10:39:40.607591 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Project-Domain-Name: Default Jul 18 10:39:40.607591 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Project-Id: feefb94984d54cbbaa70b963d956a520 Jul 18 10:39:40.607591 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-609182469 Jul 18 10:39:40.607591 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Role: member,reader Jul 18 10:39:40.607591 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Roles: member,reader Jul 18 10:39:40.609451 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/feefb94984d54cbbaa70b963d956a520"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/feefb94984d54cbbaa70b963d956a520"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/feefb94984d54cbbaa70b963d956a520"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_feefb94984d54cbbaa70b963d956a520"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jul 18 10:39:40.609451 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Tenant: tempest-AttachVolumeShelveTestJSON-609182469 Jul 18 10:39:40.609451 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Tenant-Id: feefb94984d54cbbaa70b963d956a520 Jul 18 10:39:40.609451 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-609182469 Jul 18 10:39:40.609451 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-User: tempest-AttachVolumeShelveTestJSON-609182469-project Jul 18 10:39:40.609451 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-User-Domain-Id: default Jul 18 10:39:40.609451 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-User-Domain-Name: Default Jul 18 10:39:40.609451 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-User-Id: cacc328f0f3540299310a0e53afe6acb Jul 18 10:39:40.609451 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-User-Name: tempest-AttachVolumeShelveTestJSON-609182469-project Jul 18 10:39:40.609451 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: method: > Jul 18 10:39:40.609451 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: exception: Instance 7c4da4be-98d3-4976-97aa-a3ca9b8ddf96 could not be found. Jul 18 10:39:40.609451 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: action_args: {'id': '7c4da4be-98d3-4976-97aa-a3ca9b8ddf96'} Jul 18 10:39:40.610593 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 10:39:40.610593 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:39:40.610593 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 10:39:40.610593 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 10:39:40.610593 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 10:39:40.610593 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 10:39:40.610593 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 10:39:40.610593 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 10:39:40.610593 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 10:39:40.610593 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 10:39:40.610593 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7c4da4be-98d3-4976-97aa-a3ca9b8ddf96 could not be found. Jul 18 10:39:40.610593 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi Jul 18 10:39:40.610593 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:39:40.610593 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi Jul 18 10:39:40.610593 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:39:40.610593 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:39:40.610593 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:39:40.610593 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 10:39:40.610593 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 10:39:40.610593 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 10:39:40.612229 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 10:39:40.612229 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 18 10:39:40.612229 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 18 10:39:40.612229 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 18 10:39:40.612229 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 18 10:39:40.612229 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 10:39:40.612229 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 10:39:40.612229 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 10:39:40.612229 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 10:39:40.612229 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7c4da4be-98d3-4976-97aa-a3ca9b8ddf96 could not be found. Jul 18 10:39:40.612229 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi Jul 18 10:39:40.612229 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:39:40.612229 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi Jul 18 10:39:40.612229 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:39:40.612229 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:39:40.612229 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:39:40.612229 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 10:39:40.612229 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 10:39:40.612229 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7c4da4be-98d3-4976-97aa-a3ca9b8ddf96 could not be found. Jul 18 10:39:40.612229 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi Jul 18 10:39:40.613945 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-5e019450-e8ba-4597-ab23-20de1aa063c8 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Returning 404 to user: Instance 7c4da4be-98d3-4976-97aa-a3ca9b8ddf96 could not be found. {{(pid=117880) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 10:39:40.613945 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-5e019450-e8ba-4597-ab23-20de1aa063c8 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] 10.222.0.33 "DELETE /compute/v2.1/servers/7c4da4be-98d3-4976-97aa-a3ca9b8ddf96" status: 404 len: 111 microversion: 2.20 time: 0.028887 Jul 18 10:39:40.613945 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 535/1075] 10.222.0.33 () {60 vars in 1279 bytes} [Mon Jul 18 10:39:40 2022] DELETE /compute/v2.1/servers/7c4da4be-98d3-4976-97aa-a3ca9b8ddf96 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 18 10:39:40.617215 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-a5a37679-4249-4e05-a17a-56f7ae1dd6ff tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:39:40.617947 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-a5a37679-4249-4e05-a17a-56f7ae1dd6ff tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] [instance: 7c4da4be-98d3-4976-97aa-a3ca9b8ddf96] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:39:40.625759 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-a5a37679-4249-4e05-a17a-56f7ae1dd6ff tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:39:40.626217 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-a5a37679-4249-4e05-a17a-56f7ae1dd6ff tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:39:40.626980 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-a5a37679-4249-4e05-a17a-56f7ae1dd6ff tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:39:40.627420 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-a5a37679-4249-4e05-a17a-56f7ae1dd6ff tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:39:40.640125 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.wsgi [None req-a5a37679-4249-4e05-a17a-56f7ae1dd6ff tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] HTTP exception thrown: Instance 7c4da4be-98d3-4976-97aa-a3ca9b8ddf96 could not be found. Jul 18 10:39:40.641757 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-a5a37679-4249-4e05-a17a-56f7ae1dd6ff tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Request method failure captured: Jul 18 10:39:40.641757 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: request: GET /compute/v2.1/servers/7c4da4be-98d3-4976-97aa-a3ca9b8ddf96 HTTP/1.1 Jul 18 10:39:40.641757 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: Accept: application/json Jul 18 10:39:40.641757 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: Accept-Encoding: identity Jul 18 10:39:40.641757 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: Connection: close Jul 18 10:39:40.641757 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: Content-Length: 0 Jul 18 10:39:40.641757 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: Content-Type: application/json Jul 18 10:39:40.641757 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: Host: 10.222.0.33 Jul 18 10:39:40.641757 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: Openstack-System-Scope: None Jul 18 10:39:40.641757 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: User-Agent: python-urllib3/1.26.9 Jul 18 10:39:40.641757 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Auth-Token: gAAAAABi1TcnBAPlaPHtdv5tIZlRtT0XkCSp1cYOzJpQ75bhg4uyzEacqN1-FLjMcQVoiH0DbKD4MJLRgIlPoR64pKZaLn9i6i8VTsz7xjFqS-WjgWAPUuRVb7FZ5Py6JNNB81cGYGStEleWTuQAnU5tzMZ7b50tk85d9K2dSp0Bw83-FfBykmg Jul 18 10:39:40.641757 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Domain-Id: None Jul 18 10:39:40.641757 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Domain-Name: None Jul 18 10:39:40.641757 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Identity-Status: Confirmed Jul 18 10:39:40.641757 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Is-Admin-Project: True Jul 18 10:39:40.641757 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Openstack-Nova-Api-Version: 2.20 Jul 18 10:39:40.641757 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Project-Domain-Id: default Jul 18 10:39:40.641757 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Project-Domain-Name: Default Jul 18 10:39:40.641757 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Project-Id: feefb94984d54cbbaa70b963d956a520 Jul 18 10:39:40.641757 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-609182469 Jul 18 10:39:40.641757 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Role: member,reader Jul 18 10:39:40.641757 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Roles: member,reader Jul 18 10:39:40.643484 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/feefb94984d54cbbaa70b963d956a520"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/feefb94984d54cbbaa70b963d956a520"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/feefb94984d54cbbaa70b963d956a520"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_feefb94984d54cbbaa70b963d956a520"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jul 18 10:39:40.643484 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Tenant: tempest-AttachVolumeShelveTestJSON-609182469 Jul 18 10:39:40.643484 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Tenant-Id: feefb94984d54cbbaa70b963d956a520 Jul 18 10:39:40.643484 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-609182469 Jul 18 10:39:40.643484 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-User: tempest-AttachVolumeShelveTestJSON-609182469-project Jul 18 10:39:40.643484 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-User-Domain-Id: default Jul 18 10:39:40.643484 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-User-Domain-Name: Default Jul 18 10:39:40.643484 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-User-Id: cacc328f0f3540299310a0e53afe6acb Jul 18 10:39:40.643484 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-User-Name: tempest-AttachVolumeShelveTestJSON-609182469-project Jul 18 10:39:40.643484 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: method: > Jul 18 10:39:40.643484 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: exception: Instance 7c4da4be-98d3-4976-97aa-a3ca9b8ddf96 could not be found. Jul 18 10:39:40.643484 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: action_args: {'id': '7c4da4be-98d3-4976-97aa-a3ca9b8ddf96'} Jul 18 10:39:40.644639 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 10:39:40.644639 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:39:40.644639 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 10:39:40.644639 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 10:39:40.644639 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 10:39:40.644639 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 10:39:40.644639 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 10:39:40.644639 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 10:39:40.644639 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 10:39:40.644639 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 10:39:40.644639 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7c4da4be-98d3-4976-97aa-a3ca9b8ddf96 could not be found. Jul 18 10:39:40.644639 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi Jul 18 10:39:40.644639 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:39:40.644639 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi Jul 18 10:39:40.644639 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:39:40.644639 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:39:40.644639 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:39:40.644639 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 10:39:40.644639 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 10:39:40.644639 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 10:39:40.646274 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 10:39:40.646274 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 10:39:40.646274 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 10:39:40.646274 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 10:39:40.646274 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 10:39:40.646274 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 10:39:40.646274 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 10:39:40.646274 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7c4da4be-98d3-4976-97aa-a3ca9b8ddf96 could not be found. Jul 18 10:39:40.646274 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi Jul 18 10:39:40.646274 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:39:40.646274 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi Jul 18 10:39:40.646274 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:39:40.646274 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:39:40.646274 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:39:40.646274 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 10:39:40.646274 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 10:39:40.646274 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7c4da4be-98d3-4976-97aa-a3ca9b8ddf96 could not be found. Jul 18 10:39:40.646274 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi Jul 18 10:39:40.647751 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-a5a37679-4249-4e05-a17a-56f7ae1dd6ff tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Returning 404 to user: Instance 7c4da4be-98d3-4976-97aa-a3ca9b8ddf96 could not be found. {{(pid=117879) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 10:39:40.647751 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-a5a37679-4249-4e05-a17a-56f7ae1dd6ff tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] 10.222.0.33 "GET /compute/v2.1/servers/7c4da4be-98d3-4976-97aa-a3ca9b8ddf96" status: 404 len: 111 microversion: 2.20 time: 0.029799 Jul 18 10:39:40.647751 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 541/1076] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jul 18 10:39:40 2022] GET /compute/v2.1/servers/7c4da4be-98d3-4976-97aa-a3ca9b8ddf96 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 18 10:39:41.774301 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-1f37b3a0-740a-45fd-835b-658edd2a59f6 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:39:41.774802 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-1f37b3a0-740a-45fd-835b-658edd2a59f6 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] [instance: b1a84290-3520-427e-af49-f380d2a144bb] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:39:41.781743 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-1f37b3a0-740a-45fd-835b-658edd2a59f6 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:39:41.782190 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-1f37b3a0-740a-45fd-835b-658edd2a59f6 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:39:41.782948 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-1f37b3a0-740a-45fd-835b-658edd2a59f6 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:39:41.783384 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-1f37b3a0-740a-45fd-835b-658edd2a59f6 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:39:41.797169 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.wsgi [None req-1f37b3a0-740a-45fd-835b-658edd2a59f6 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] HTTP exception thrown: Instance b1a84290-3520-427e-af49-f380d2a144bb could not be found. Jul 18 10:39:41.798701 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-1f37b3a0-740a-45fd-835b-658edd2a59f6 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Request method failure captured: Jul 18 10:39:41.798701 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: request: DELETE /compute/v2.1/servers/b1a84290-3520-427e-af49-f380d2a144bb HTTP/1.1 Jul 18 10:39:41.798701 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: Accept: application/json Jul 18 10:39:41.798701 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: Accept-Encoding: identity Jul 18 10:39:41.798701 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: Connection: close Jul 18 10:39:41.798701 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: Content-Length: 0 Jul 18 10:39:41.798701 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: Content-Type: application/json Jul 18 10:39:41.798701 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: Host: 10.222.0.33 Jul 18 10:39:41.798701 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: Openstack-System-Scope: None Jul 18 10:39:41.798701 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: User-Agent: python-urllib3/1.26.9 Jul 18 10:39:41.798701 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Auth-Token: gAAAAABi1TcnBAPlaPHtdv5tIZlRtT0XkCSp1cYOzJpQ75bhg4uyzEacqN1-FLjMcQVoiH0DbKD4MJLRgIlPoR64pKZaLn9i6i8VTsz7xjFqS-WjgWAPUuRVb7FZ5Py6JNNB81cGYGStEleWTuQAnU5tzMZ7b50tk85d9K2dSp0Bw83-FfBykmg Jul 18 10:39:41.798701 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Domain-Id: None Jul 18 10:39:41.798701 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Domain-Name: None Jul 18 10:39:41.798701 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Identity-Status: Confirmed Jul 18 10:39:41.798701 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Is-Admin-Project: True Jul 18 10:39:41.798701 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Openstack-Nova-Api-Version: 2.20 Jul 18 10:39:41.798701 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Project-Domain-Id: default Jul 18 10:39:41.798701 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Project-Domain-Name: Default Jul 18 10:39:41.798701 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Project-Id: feefb94984d54cbbaa70b963d956a520 Jul 18 10:39:41.798701 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-609182469 Jul 18 10:39:41.798701 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Role: member,reader Jul 18 10:39:41.798701 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Roles: member,reader Jul 18 10:39:41.800378 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/feefb94984d54cbbaa70b963d956a520"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/feefb94984d54cbbaa70b963d956a520"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/feefb94984d54cbbaa70b963d956a520"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_feefb94984d54cbbaa70b963d956a520"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jul 18 10:39:41.800378 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Tenant: tempest-AttachVolumeShelveTestJSON-609182469 Jul 18 10:39:41.800378 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Tenant-Id: feefb94984d54cbbaa70b963d956a520 Jul 18 10:39:41.800378 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-609182469 Jul 18 10:39:41.800378 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-User: tempest-AttachVolumeShelveTestJSON-609182469-project Jul 18 10:39:41.800378 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-User-Domain-Id: default Jul 18 10:39:41.800378 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-User-Domain-Name: Default Jul 18 10:39:41.800378 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-User-Id: cacc328f0f3540299310a0e53afe6acb Jul 18 10:39:41.800378 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-User-Name: tempest-AttachVolumeShelveTestJSON-609182469-project Jul 18 10:39:41.800378 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: method: > Jul 18 10:39:41.800378 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: exception: Instance b1a84290-3520-427e-af49-f380d2a144bb could not be found. Jul 18 10:39:41.800378 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: action_args: {'id': 'b1a84290-3520-427e-af49-f380d2a144bb'} Jul 18 10:39:41.801215 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 10:39:41.801215 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:39:41.801215 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 10:39:41.801215 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 10:39:41.801215 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 10:39:41.801215 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 10:39:41.801215 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 10:39:41.801215 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 10:39:41.801215 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 10:39:41.801215 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 10:39:41.801215 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b1a84290-3520-427e-af49-f380d2a144bb could not be found. Jul 18 10:39:41.801215 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi Jul 18 10:39:41.801215 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:39:41.801215 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi Jul 18 10:39:41.801215 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:39:41.801215 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:39:41.801215 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:39:41.801215 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 10:39:41.801215 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 10:39:41.801215 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 10:39:41.802660 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 10:39:41.802660 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 18 10:39:41.802660 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 18 10:39:41.802660 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 18 10:39:41.802660 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 18 10:39:41.802660 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 10:39:41.802660 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 10:39:41.802660 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 10:39:41.802660 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 10:39:41.802660 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b1a84290-3520-427e-af49-f380d2a144bb could not be found. Jul 18 10:39:41.802660 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi Jul 18 10:39:41.802660 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:39:41.802660 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi Jul 18 10:39:41.802660 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:39:41.802660 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:39:41.802660 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:39:41.802660 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 10:39:41.802660 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 10:39:41.802660 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b1a84290-3520-427e-af49-f380d2a144bb could not be found. Jul 18 10:39:41.802660 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi Jul 18 10:39:41.804484 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-1f37b3a0-740a-45fd-835b-658edd2a59f6 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Returning 404 to user: Instance b1a84290-3520-427e-af49-f380d2a144bb could not be found. {{(pid=117880) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 10:39:41.804484 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-1f37b3a0-740a-45fd-835b-658edd2a59f6 tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] 10.222.0.33 "DELETE /compute/v2.1/servers/b1a84290-3520-427e-af49-f380d2a144bb" status: 404 len: 111 microversion: 2.20 time: 0.029662 Jul 18 10:39:41.804484 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 536/1077] 10.222.0.33 () {60 vars in 1279 bytes} [Mon Jul 18 10:39:41 2022] DELETE /compute/v2.1/servers/b1a84290-3520-427e-af49-f380d2a144bb => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 18 10:39:41.808759 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-bd7913fd-29bc-4d03-9d68-58b60a50423d tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:39:41.809384 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-bd7913fd-29bc-4d03-9d68-58b60a50423d tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] [instance: b1a84290-3520-427e-af49-f380d2a144bb] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:39:41.816142 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-bd7913fd-29bc-4d03-9d68-58b60a50423d tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:39:41.816639 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-bd7913fd-29bc-4d03-9d68-58b60a50423d tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:39:41.817411 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-bd7913fd-29bc-4d03-9d68-58b60a50423d tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:39:41.817853 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-bd7913fd-29bc-4d03-9d68-58b60a50423d tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:39:41.830713 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.wsgi [None req-bd7913fd-29bc-4d03-9d68-58b60a50423d tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] HTTP exception thrown: Instance b1a84290-3520-427e-af49-f380d2a144bb could not be found. Jul 18 10:39:41.832221 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-bd7913fd-29bc-4d03-9d68-58b60a50423d tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Request method failure captured: Jul 18 10:39:41.832221 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: request: GET /compute/v2.1/servers/b1a84290-3520-427e-af49-f380d2a144bb HTTP/1.1 Jul 18 10:39:41.832221 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: Accept: application/json Jul 18 10:39:41.832221 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: Accept-Encoding: identity Jul 18 10:39:41.832221 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: Connection: close Jul 18 10:39:41.832221 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: Content-Length: 0 Jul 18 10:39:41.832221 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: Content-Type: application/json Jul 18 10:39:41.832221 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: Host: 10.222.0.33 Jul 18 10:39:41.832221 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: Openstack-System-Scope: None Jul 18 10:39:41.832221 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: User-Agent: python-urllib3/1.26.9 Jul 18 10:39:41.832221 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Auth-Token: gAAAAABi1TcnBAPlaPHtdv5tIZlRtT0XkCSp1cYOzJpQ75bhg4uyzEacqN1-FLjMcQVoiH0DbKD4MJLRgIlPoR64pKZaLn9i6i8VTsz7xjFqS-WjgWAPUuRVb7FZ5Py6JNNB81cGYGStEleWTuQAnU5tzMZ7b50tk85d9K2dSp0Bw83-FfBykmg Jul 18 10:39:41.832221 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Domain-Id: None Jul 18 10:39:41.832221 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Domain-Name: None Jul 18 10:39:41.832221 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Identity-Status: Confirmed Jul 18 10:39:41.832221 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Is-Admin-Project: True Jul 18 10:39:41.832221 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Openstack-Nova-Api-Version: 2.20 Jul 18 10:39:41.832221 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Project-Domain-Id: default Jul 18 10:39:41.832221 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Project-Domain-Name: Default Jul 18 10:39:41.832221 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Project-Id: feefb94984d54cbbaa70b963d956a520 Jul 18 10:39:41.832221 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-609182469 Jul 18 10:39:41.832221 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Role: member,reader Jul 18 10:39:41.832221 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Roles: member,reader Jul 18 10:39:41.833925 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/feefb94984d54cbbaa70b963d956a520"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/feefb94984d54cbbaa70b963d956a520"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/feefb94984d54cbbaa70b963d956a520"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_feefb94984d54cbbaa70b963d956a520"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jul 18 10:39:41.833925 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Tenant: tempest-AttachVolumeShelveTestJSON-609182469 Jul 18 10:39:41.833925 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Tenant-Id: feefb94984d54cbbaa70b963d956a520 Jul 18 10:39:41.833925 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-609182469 Jul 18 10:39:41.833925 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-User: tempest-AttachVolumeShelveTestJSON-609182469-project Jul 18 10:39:41.833925 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-User-Domain-Id: default Jul 18 10:39:41.833925 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-User-Domain-Name: Default Jul 18 10:39:41.833925 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-User-Id: cacc328f0f3540299310a0e53afe6acb Jul 18 10:39:41.833925 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-User-Name: tempest-AttachVolumeShelveTestJSON-609182469-project Jul 18 10:39:41.833925 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: method: > Jul 18 10:39:41.833925 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: exception: Instance b1a84290-3520-427e-af49-f380d2a144bb could not be found. Jul 18 10:39:41.833925 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: action_args: {'id': 'b1a84290-3520-427e-af49-f380d2a144bb'} Jul 18 10:39:41.834891 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 10:39:41.834891 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:39:41.834891 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 10:39:41.834891 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 10:39:41.834891 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 10:39:41.834891 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 10:39:41.834891 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 10:39:41.834891 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 10:39:41.834891 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 10:39:41.834891 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 10:39:41.834891 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b1a84290-3520-427e-af49-f380d2a144bb could not be found. Jul 18 10:39:41.834891 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi Jul 18 10:39:41.834891 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:39:41.834891 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi Jul 18 10:39:41.834891 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:39:41.834891 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:39:41.834891 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:39:41.834891 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 10:39:41.834891 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 10:39:41.834891 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 10:39:41.836411 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 10:39:41.836411 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 10:39:41.836411 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 10:39:41.836411 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 10:39:41.836411 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 10:39:41.836411 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 10:39:41.836411 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 10:39:41.836411 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b1a84290-3520-427e-af49-f380d2a144bb could not be found. Jul 18 10:39:41.836411 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi Jul 18 10:39:41.836411 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:39:41.836411 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi Jul 18 10:39:41.836411 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:39:41.836411 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:39:41.836411 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:39:41.836411 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 10:39:41.836411 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 10:39:41.836411 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b1a84290-3520-427e-af49-f380d2a144bb could not be found. Jul 18 10:39:41.836411 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi Jul 18 10:39:41.837816 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-bd7913fd-29bc-4d03-9d68-58b60a50423d tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] Returning 404 to user: Instance b1a84290-3520-427e-af49-f380d2a144bb could not be found. {{(pid=117879) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 10:39:41.837816 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-bd7913fd-29bc-4d03-9d68-58b60a50423d tempest-AttachVolumeShelveTestJSON-609182469 tempest-AttachVolumeShelveTestJSON-609182469-project] 10.222.0.33 "GET /compute/v2.1/servers/b1a84290-3520-427e-af49-f380d2a144bb" status: 404 len: 111 microversion: 2.20 time: 0.028898 Jul 18 10:39:41.837816 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 542/1078] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jul 18 10:39:41 2022] GET /compute/v2.1/servers/b1a84290-3520-427e-af49-f380d2a144bb => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 18 10:39:45.852673 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-e2b1f52c-3e77-47fb-a90f-014601ee2e54 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:39:45.854237 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-e2b1f52c-3e77-47fb-a90f-014601ee2e54 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] [instance: 6e2ab0bb-d92f-4441-bdea-2bc427e441f8] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:39:45.860780 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-e2b1f52c-3e77-47fb-a90f-014601ee2e54 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:39:45.861485 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-e2b1f52c-3e77-47fb-a90f-014601ee2e54 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:39:45.862437 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-e2b1f52c-3e77-47fb-a90f-014601ee2e54 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:39:45.863054 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-e2b1f52c-3e77-47fb-a90f-014601ee2e54 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:39:45.864786 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [req-e1c587f6-d582-42c6-b8c2-0d08649aa805 req-e073604f-9f0b-4f1d-ab4c-b9eac0711bc7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6e2ab0bb-d92f-4441-bdea-2bc427e441f8", "tag": "9c584805-1812-494e-8d2b-019452f06e9c"}]} {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:39:45.876841 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [req-e1c587f6-d582-42c6-b8c2-0d08649aa805 req-e073604f-9f0b-4f1d-ab4c-b9eac0711bc7 service nova] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:39:45.879047 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [req-e1c587f6-d582-42c6-b8c2-0d08649aa805 req-e073604f-9f0b-4f1d-ab4c-b9eac0711bc7 service nova] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:39:45.894781 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-e2b1f52c-3e77-47fb-a90f-014601ee2e54 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] [instance: 6e2ab0bb-d92f-4441-bdea-2bc427e441f8] Going to try to terminate instance {{(pid=117880) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 10:39:45.901742 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.compute.server_external_events [req-e1c587f6-d582-42c6-b8c2-0d08649aa805 req-e073604f-9f0b-4f1d-ab4c-b9eac0711bc7 service nova] Creating event network-changed:9c584805-1812-494e-8d2b-019452f06e9c for instance 6e2ab0bb-d92f-4441-bdea-2bc427e441f8 on hv-cinder-83754 Jul 18 10:39:45.908519 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [req-e1c587f6-d582-42c6-b8c2-0d08649aa805 req-e073604f-9f0b-4f1d-ab4c-b9eac0711bc7 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051200 Jul 18 10:39:45.909460 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 543/1079] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jul 18 10:39:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 10:39:45.990519 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-e2b1f52c-3e77-47fb-a90f-014601ee2e54 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] 10.222.0.33 "DELETE /compute/v2.1/servers/6e2ab0bb-d92f-4441-bdea-2bc427e441f8" status: 204 len: 0 microversion: 2.1 time: 0.140768 Jul 18 10:39:45.991835 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 537/1080] 10.222.0.33 () {58 vars in 1238 bytes} [Mon Jul 18 10:39:45 2022] DELETE /compute/v2.1/servers/6e2ab0bb-d92f-4441-bdea-2bc427e441f8 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 10:39:46.003311 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-dae5f25c-931f-49c2-a47a-f6f7fb0fc295 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:39:46.004524 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-dae5f25c-931f-49c2-a47a-f6f7fb0fc295 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] [instance: 6e2ab0bb-d92f-4441-bdea-2bc427e441f8] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:39:46.011567 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-dae5f25c-931f-49c2-a47a-f6f7fb0fc295 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:39:46.012479 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-dae5f25c-931f-49c2-a47a-f6f7fb0fc295 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:39:46.013301 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-dae5f25c-931f-49c2-a47a-f6f7fb0fc295 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:39:46.014378 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-dae5f25c-931f-49c2-a47a-f6f7fb0fc295 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:39:46.199296 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-dae5f25c-931f-49c2-a47a-f6f7fb0fc295 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9eb8d188e040bca894e038955f2402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c656b71bbd447cba7d11335c928dfda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:39:46.210571 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-dae5f25c-931f-49c2-a47a-f6f7fb0fc295 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] 10.222.0.33 "GET /compute/v2.1/servers/6e2ab0bb-d92f-4441-bdea-2bc427e441f8" status: 200 len: 1575 microversion: 2.1 time: 0.214120 Jul 18 10:39:46.211259 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 544/1081] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:39:45 2022] GET /compute/v2.1/servers/6e2ab0bb-d92f-4441-bdea-2bc427e441f8 => generated 1575 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:39:46.856220 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-fb2a3da4-d64a-4c69-a9d8-3eb0135b2391 tempest-VolumesNegativeTest-586540144 tempest-VolumesNegativeTest-586540144-project] Action: 'create', calling method: .version_select at 0x7f9f4a21e670>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1971092305", "metadata": {"Type": "work"}}} {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:39:46.882347 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-fb2a3da4-d64a-4c69-a9d8-3eb0135b2391 tempest-VolumesNegativeTest-586540144 tempest-VolumesNegativeTest-586540144-project] Request method failure captured: Jul 18 10:39:46.882347 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 18 10:39:46.882347 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: Accept: application/json Jul 18 10:39:46.882347 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: Accept-Encoding: identity Jul 18 10:39:46.882347 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: Connection: close Jul 18 10:39:46.882347 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: Content-Length: 122 Jul 18 10:39:46.882347 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: Content-Type: application/json Jul 18 10:39:46.882347 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: Host: 10.222.0.33 Jul 18 10:39:46.882347 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: Openstack-System-Scope: None Jul 18 10:39:46.882347 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: User-Agent: python-urllib3/1.26.9 Jul 18 10:39:46.882347 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Auth-Token: gAAAAABi1ThymiB1pklVWZDaHAOM7KLOcTL9_HmgOZdFSQ94TopAQt2gw1hNG_4ga67S_GE7SHIPpBby-hWB5x5Z1-vKefXkU8PczdlCcOY5OmXIItR9BPCTGHYlxwaSuszN-fri0Opg_ZB0mppdInKMNNPK8R1es7MWVn39jAsqH5MAsNZWtO0 Jul 18 10:39:46.882347 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Domain-Id: None Jul 18 10:39:46.882347 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Domain-Name: None Jul 18 10:39:46.882347 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Identity-Status: Confirmed Jul 18 10:39:46.882347 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Is-Admin-Project: True Jul 18 10:39:46.882347 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Project-Domain-Id: default Jul 18 10:39:46.882347 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Project-Domain-Name: Default Jul 18 10:39:46.882347 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Project-Id: 9d61432080064383bc2629af75576900 Jul 18 10:39:46.882347 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Project-Name: tempest-VolumesNegativeTest-586540144 Jul 18 10:39:46.882347 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Role: member,reader Jul 18 10:39:46.882347 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Roles: member,reader Jul 18 10:39:46.884056 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/9d61432080064383bc2629af75576900"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/9d61432080064383bc2629af75576900"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/9d61432080064383bc2629af75576900"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_9d61432080064383bc2629af75576900"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jul 18 10:39:46.884056 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Tenant: tempest-VolumesNegativeTest-586540144 Jul 18 10:39:46.884056 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Tenant-Id: 9d61432080064383bc2629af75576900 Jul 18 10:39:46.884056 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Tenant-Name: tempest-VolumesNegativeTest-586540144 Jul 18 10:39:46.884056 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-User: tempest-VolumesNegativeTest-586540144-project Jul 18 10:39:46.884056 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-User-Domain-Id: default Jul 18 10:39:46.884056 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-User-Domain-Name: Default Jul 18 10:39:46.884056 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-User-Id: 5b7396918821425392a2c93d5191ec7c Jul 18 10:39:46.884056 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-User-Name: tempest-VolumesNegativeTest-586540144-project Jul 18 10:39:46.884056 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: Jul 18 10:39:46.884056 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1971092305", "metadata": {"Type": "work"}}} Jul 18 10:39:46.884056 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: method: Jul 18 10:39:46.884056 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 18 10:39:46.885083 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1971092305', 'metadata': {'Type': 'work'}}}} Jul 18 10:39:46.885083 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 10:39:46.885083 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:39:46.885083 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 18 10:39:46.885083 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 18 10:39:46.885083 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 18 10:39:46.885083 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi raise error Jul 18 10:39:46.885083 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jul 18 10:39:46.885083 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi Jul 18 10:39:46.885083 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 18 10:39:46.885083 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 18 10:39:46.885083 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi Jul 18 10:39:46.885083 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 18 10:39:46.885083 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi '#$%' Jul 18 10:39:46.885083 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi Jul 18 10:39:46.885083 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:39:46.885083 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi Jul 18 10:39:46.885083 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:39:46.885083 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:39:46.885083 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:39:46.885083 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 10:39:46.885083 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 10:39:46.887283 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 10:39:46.887283 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 10:39:46.887283 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 10:39:46.887283 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 10:39:46.887283 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 18 10:39:46.887283 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 18 10:39:46.887283 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 18 10:39:46.887283 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 18 10:39:46.887283 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 18 10:39:46.887283 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 18 10:39:46.887283 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 18 10:39:46.887283 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi Jul 18 10:39:46.887283 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:39:46.887283 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi Jul 18 10:39:46.887283 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:39:46.887283 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:39:46.887283 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:39:46.887283 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 18 10:39:46.887283 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 18 10:39:46.889310 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 18 10:39:46.889310 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi Jul 18 10:39:46.889310 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-fb2a3da4-d64a-4c69-a9d8-3eb0135b2391 tempest-VolumesNegativeTest-586540144 tempest-VolumesNegativeTest-586540144-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=117880) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 10:39:46.889310 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-fb2a3da4-d64a-4c69-a9d8-3eb0135b2391 tempest-VolumesNegativeTest-586540144 tempest-VolumesNegativeTest-586540144-project] 10.222.0.33 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.156837 Jul 18 10:39:46.893387 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-9db32cd9-ab62-4ea0-ab0a-8a649b41cef9 tempest-VolumesNegativeTest-586540144 tempest-VolumesNegativeTest-586540144-project] Action: 'create', calling method: .version_select at 0x7f9f4a086ca0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-2018287578", "metadata": {"Type": "work"}}} {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:39:46.895955 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 538/1082] 10.222.0.33 () {60 vars in 1155 bytes} [Mon Jul 18 10:39:46 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 170 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 18 10:39:46.896707 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-9db32cd9-ab62-4ea0-ab0a-8a649b41cef9 tempest-VolumesNegativeTest-586540144 tempest-VolumesNegativeTest-586540144-project] Request method failure captured: Jul 18 10:39:46.896707 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 18 10:39:46.896707 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: Accept: application/json Jul 18 10:39:46.896707 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: Accept-Encoding: identity Jul 18 10:39:46.896707 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: Connection: close Jul 18 10:39:46.896707 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: Content-Length: 120 Jul 18 10:39:46.896707 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: Content-Type: application/json Jul 18 10:39:46.896707 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: Host: 10.222.0.33 Jul 18 10:39:46.896707 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: Openstack-System-Scope: None Jul 18 10:39:46.896707 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: User-Agent: python-urllib3/1.26.9 Jul 18 10:39:46.896707 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Auth-Token: gAAAAABi1ThymiB1pklVWZDaHAOM7KLOcTL9_HmgOZdFSQ94TopAQt2gw1hNG_4ga67S_GE7SHIPpBby-hWB5x5Z1-vKefXkU8PczdlCcOY5OmXIItR9BPCTGHYlxwaSuszN-fri0Opg_ZB0mppdInKMNNPK8R1es7MWVn39jAsqH5MAsNZWtO0 Jul 18 10:39:46.896707 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Domain-Id: None Jul 18 10:39:46.896707 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Domain-Name: None Jul 18 10:39:46.896707 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Identity-Status: Confirmed Jul 18 10:39:46.896707 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Is-Admin-Project: True Jul 18 10:39:46.896707 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Project-Domain-Id: default Jul 18 10:39:46.896707 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Project-Domain-Name: Default Jul 18 10:39:46.896707 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Project-Id: 9d61432080064383bc2629af75576900 Jul 18 10:39:46.896707 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Project-Name: tempest-VolumesNegativeTest-586540144 Jul 18 10:39:46.896707 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Role: member,reader Jul 18 10:39:46.896707 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Roles: member,reader Jul 18 10:39:46.898438 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/9d61432080064383bc2629af75576900"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/9d61432080064383bc2629af75576900"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/9d61432080064383bc2629af75576900"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_9d61432080064383bc2629af75576900"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jul 18 10:39:46.898438 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Tenant: tempest-VolumesNegativeTest-586540144 Jul 18 10:39:46.898438 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Tenant-Id: 9d61432080064383bc2629af75576900 Jul 18 10:39:46.898438 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Tenant-Name: tempest-VolumesNegativeTest-586540144 Jul 18 10:39:46.898438 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-User: tempest-VolumesNegativeTest-586540144-project Jul 18 10:39:46.898438 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-User-Domain-Id: default Jul 18 10:39:46.898438 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-User-Domain-Name: Default Jul 18 10:39:46.898438 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-User-Id: 5b7396918821425392a2c93d5191ec7c Jul 18 10:39:46.898438 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-User-Name: tempest-VolumesNegativeTest-586540144-project Jul 18 10:39:46.898438 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: Jul 18 10:39:46.898438 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-2018287578", "metadata": {"Type": "work"}}} Jul 18 10:39:46.898438 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: method: Jul 18 10:39:46.898438 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 18 10:39:46.899313 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-2018287578', 'metadata': {'Type': 'work'}}}} Jul 18 10:39:46.899313 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 10:39:46.899313 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:39:46.899313 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 18 10:39:46.899313 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 18 10:39:46.899313 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 18 10:39:46.899313 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi raise error Jul 18 10:39:46.899313 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jul 18 10:39:46.899313 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi Jul 18 10:39:46.899313 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jul 18 10:39:46.899313 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 18 10:39:46.899313 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi Jul 18 10:39:46.899313 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 18 10:39:46.899313 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi '0' Jul 18 10:39:46.899313 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi Jul 18 10:39:46.899313 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:39:46.899313 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi Jul 18 10:39:46.899313 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:39:46.899313 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:39:46.899313 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:39:46.899313 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 10:39:46.899313 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 10:39:46.900939 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 10:39:46.900939 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 10:39:46.900939 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 10:39:46.900939 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 10:39:46.900939 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 18 10:39:46.900939 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 18 10:39:46.900939 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 18 10:39:46.900939 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 18 10:39:46.900939 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 18 10:39:46.900939 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 18 10:39:46.900939 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 18 10:39:46.900939 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi Jul 18 10:39:46.900939 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:39:46.900939 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi Jul 18 10:39:46.900939 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:39:46.900939 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:39:46.900939 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:39:46.900939 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 18 10:39:46.900939 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 18 10:39:46.902252 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 18 10:39:46.902252 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi Jul 18 10:39:46.902252 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-9db32cd9-ab62-4ea0-ab0a-8a649b41cef9 tempest-VolumesNegativeTest-586540144 tempest-VolumesNegativeTest-586540144-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=117879) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 10:39:46.902252 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-9db32cd9-ab62-4ea0-ab0a-8a649b41cef9 tempest-VolumesNegativeTest-586540144 tempest-VolumesNegativeTest-586540144-project] 10.222.0.33 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.008549 Jul 18 10:39:46.902252 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 545/1083] 10.222.0.33 () {60 vars in 1155 bytes} [Mon Jul 18 10:39:46 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 18 10:39:46.908691 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-3bf1fa34-f303-4b5d-a44e-1d574d5d57cc tempest-VolumesNegativeTest-586540144 tempest-VolumesNegativeTest-586540144-project] Action: 'create', calling method: .version_select at 0x7f9f4a1df0d0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1957530145", "metadata": {"Type": "work"}}} {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:39:46.911858 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-3bf1fa34-f303-4b5d-a44e-1d574d5d57cc tempest-VolumesNegativeTest-586540144 tempest-VolumesNegativeTest-586540144-project] Request method failure captured: Jul 18 10:39:46.911858 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 18 10:39:46.911858 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: Accept: application/json Jul 18 10:39:46.911858 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: Accept-Encoding: identity Jul 18 10:39:46.911858 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: Connection: close Jul 18 10:39:46.911858 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: Content-Length: 119 Jul 18 10:39:46.911858 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: Content-Type: application/json Jul 18 10:39:46.911858 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: Host: 10.222.0.33 Jul 18 10:39:46.911858 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: Openstack-System-Scope: None Jul 18 10:39:46.911858 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: User-Agent: python-urllib3/1.26.9 Jul 18 10:39:46.911858 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Auth-Token: gAAAAABi1ThymiB1pklVWZDaHAOM7KLOcTL9_HmgOZdFSQ94TopAQt2gw1hNG_4ga67S_GE7SHIPpBby-hWB5x5Z1-vKefXkU8PczdlCcOY5OmXIItR9BPCTGHYlxwaSuszN-fri0Opg_ZB0mppdInKMNNPK8R1es7MWVn39jAsqH5MAsNZWtO0 Jul 18 10:39:46.911858 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Domain-Id: None Jul 18 10:39:46.911858 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Domain-Name: None Jul 18 10:39:46.911858 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Identity-Status: Confirmed Jul 18 10:39:46.911858 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Is-Admin-Project: True Jul 18 10:39:46.911858 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Project-Domain-Id: default Jul 18 10:39:46.911858 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Project-Domain-Name: Default Jul 18 10:39:46.911858 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Project-Id: 9d61432080064383bc2629af75576900 Jul 18 10:39:46.911858 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Project-Name: tempest-VolumesNegativeTest-586540144 Jul 18 10:39:46.911858 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Role: member,reader Jul 18 10:39:46.911858 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Roles: member,reader Jul 18 10:39:46.913679 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/9d61432080064383bc2629af75576900"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/9d61432080064383bc2629af75576900"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/9d61432080064383bc2629af75576900"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_9d61432080064383bc2629af75576900"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jul 18 10:39:46.913679 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Tenant: tempest-VolumesNegativeTest-586540144 Jul 18 10:39:46.913679 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Tenant-Id: 9d61432080064383bc2629af75576900 Jul 18 10:39:46.913679 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Tenant-Name: tempest-VolumesNegativeTest-586540144 Jul 18 10:39:46.913679 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-User: tempest-VolumesNegativeTest-586540144-project Jul 18 10:39:46.913679 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-User-Domain-Id: default Jul 18 10:39:46.913679 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-User-Domain-Name: Default Jul 18 10:39:46.913679 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-User-Id: 5b7396918821425392a2c93d5191ec7c Jul 18 10:39:46.913679 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-User-Name: tempest-VolumesNegativeTest-586540144-project Jul 18 10:39:46.913679 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: Jul 18 10:39:46.913679 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1957530145", "metadata": {"Type": "work"}}} Jul 18 10:39:46.913679 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: method: Jul 18 10:39:46.913679 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 18 10:39:46.914540 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1957530145', 'metadata': {'Type': 'work'}}}} Jul 18 10:39:46.914540 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 10:39:46.914540 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:39:46.914540 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 18 10:39:46.914540 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 18 10:39:46.914540 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 18 10:39:46.914540 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi raise error Jul 18 10:39:46.914540 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jul 18 10:39:46.914540 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi Jul 18 10:39:46.914540 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 18 10:39:46.914540 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 18 10:39:46.914540 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi Jul 18 10:39:46.914540 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 18 10:39:46.914540 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi '' Jul 18 10:39:46.914540 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi Jul 18 10:39:46.914540 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:39:46.914540 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi Jul 18 10:39:46.914540 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:39:46.914540 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:39:46.914540 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:39:46.914540 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 10:39:46.914540 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 10:39:46.915965 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 10:39:46.915965 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 10:39:46.915965 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 10:39:46.915965 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 10:39:46.915965 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 18 10:39:46.915965 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 18 10:39:46.915965 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 18 10:39:46.915965 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 18 10:39:46.915965 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 18 10:39:46.915965 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 18 10:39:46.915965 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 18 10:39:46.915965 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi Jul 18 10:39:46.915965 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:39:46.915965 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi Jul 18 10:39:46.915965 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:39:46.915965 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:39:46.915965 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:39:46.915965 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 18 10:39:46.915965 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 18 10:39:46.917166 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 18 10:39:46.917166 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi Jul 18 10:39:46.917166 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-3bf1fa34-f303-4b5d-a44e-1d574d5d57cc tempest-VolumesNegativeTest-586540144 tempest-VolumesNegativeTest-586540144-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=117880) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 10:39:46.917166 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-3bf1fa34-f303-4b5d-a44e-1d574d5d57cc tempest-VolumesNegativeTest-586540144 tempest-VolumesNegativeTest-586540144-project] 10.222.0.33 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.009387 Jul 18 10:39:46.917166 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 539/1084] 10.222.0.33 () {60 vars in 1155 bytes} [Mon Jul 18 10:39:46 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 18 10:39:46.924171 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-e9e89e4e-8365-45f3-9b23-46fdc2ca2b77 tempest-VolumesNegativeTest-586540144 tempest-VolumesNegativeTest-586540144-project] Calling method '.version_select at 0x7f9f4a03cdc0>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:39:46.953213 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.wsgi [None req-e9e89e4e-8365-45f3-9b23-46fdc2ca2b77 tempest-VolumesNegativeTest-586540144 tempest-VolumesNegativeTest-586540144-project] HTTP exception thrown: Volume tempest-invalid-748281638 could not be found. Jul 18 10:39:46.955125 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-e9e89e4e-8365-45f3-9b23-46fdc2ca2b77 tempest-VolumesNegativeTest-586540144 tempest-VolumesNegativeTest-586540144-project] Request method failure captured: Jul 18 10:39:46.955125 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-748281638 HTTP/1.1 Jul 18 10:39:46.955125 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: Accept: application/json Jul 18 10:39:46.955125 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: Accept-Encoding: identity Jul 18 10:39:46.955125 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: Connection: close Jul 18 10:39:46.955125 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: Content-Length: 0 Jul 18 10:39:46.955125 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: Content-Type: application/json Jul 18 10:39:46.955125 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: Host: 10.222.0.33 Jul 18 10:39:46.955125 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: Openstack-System-Scope: None Jul 18 10:39:46.955125 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: User-Agent: python-urllib3/1.26.9 Jul 18 10:39:46.955125 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Auth-Token: gAAAAABi1ThymiB1pklVWZDaHAOM7KLOcTL9_HmgOZdFSQ94TopAQt2gw1hNG_4ga67S_GE7SHIPpBby-hWB5x5Z1-vKefXkU8PczdlCcOY5OmXIItR9BPCTGHYlxwaSuszN-fri0Opg_ZB0mppdInKMNNPK8R1es7MWVn39jAsqH5MAsNZWtO0 Jul 18 10:39:46.955125 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Domain-Id: None Jul 18 10:39:46.955125 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Domain-Name: None Jul 18 10:39:46.955125 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Identity-Status: Confirmed Jul 18 10:39:46.955125 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Is-Admin-Project: True Jul 18 10:39:46.955125 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Project-Domain-Id: default Jul 18 10:39:46.955125 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Project-Domain-Name: Default Jul 18 10:39:46.955125 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Project-Id: 9d61432080064383bc2629af75576900 Jul 18 10:39:46.955125 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Project-Name: tempest-VolumesNegativeTest-586540144 Jul 18 10:39:46.955125 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Role: member,reader Jul 18 10:39:46.955125 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Roles: member,reader Jul 18 10:39:46.956798 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/9d61432080064383bc2629af75576900"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/9d61432080064383bc2629af75576900"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/9d61432080064383bc2629af75576900"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_9d61432080064383bc2629af75576900"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jul 18 10:39:46.956798 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Tenant: tempest-VolumesNegativeTest-586540144 Jul 18 10:39:46.956798 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Tenant-Id: 9d61432080064383bc2629af75576900 Jul 18 10:39:46.956798 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Tenant-Name: tempest-VolumesNegativeTest-586540144 Jul 18 10:39:46.956798 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-User: tempest-VolumesNegativeTest-586540144-project Jul 18 10:39:46.956798 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-User-Domain-Id: default Jul 18 10:39:46.956798 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-User-Domain-Name: Default Jul 18 10:39:46.956798 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-User-Id: 5b7396918821425392a2c93d5191ec7c Jul 18 10:39:46.956798 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-User-Name: tempest-VolumesNegativeTest-586540144-project Jul 18 10:39:46.956798 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: method: Jul 18 10:39:46.956798 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: exception: Volume tempest-invalid-748281638 could not be found. Jul 18 10:39:46.956798 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: action_args: {'id': 'tempest-invalid-748281638'} Jul 18 10:39:46.956798 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 10:39:46.957808 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:39:46.957808 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 18 10:39:46.957808 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 18 10:39:46.957808 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 18 10:39:46.957808 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 18 10:39:46.957808 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 18 10:39:46.957808 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 18 10:39:46.957808 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 18 10:39:46.957808 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 18 10:39:46.957808 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 18 10:39:46.957808 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 18 10:39:46.957808 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 18 10:39:46.957808 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 18 10:39:46.957808 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 18 10:39:46.957808 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 18 10:39:46.957808 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-748281638 could not be found. (HTTP 404) (Request-ID: req-372a15fd-54f0-4e41-843b-696278fddccc) Jul 18 10:39:46.957808 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi Jul 18 10:39:46.957808 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:39:46.957808 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi Jul 18 10:39:46.959416 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:39:46.959416 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 18 10:39:46.959416 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 18 10:39:46.959416 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 18 10:39:46.959416 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 18 10:39:46.959416 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 18 10:39:46.959416 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 18 10:39:46.959416 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 18 10:39:46.959416 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 18 10:39:46.959416 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 18 10:39:46.959416 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 18 10:39:46.959416 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 18 10:39:46.959416 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 18 10:39:46.959416 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 18 10:39:46.959416 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 18 10:39:46.959416 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 18 10:39:46.959416 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 18 10:39:46.959416 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 18 10:39:46.959416 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 18 10:39:46.961030 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 18 10:39:46.961030 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 18 10:39:46.961030 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 18 10:39:46.961030 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 18 10:39:46.961030 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-748281638 could not be found. Jul 18 10:39:46.961030 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi Jul 18 10:39:46.961030 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:39:46.961030 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi Jul 18 10:39:46.961030 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:39:46.961030 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:39:46.961030 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:39:46.961030 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 10:39:46.961030 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 10:39:46.961030 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 10:39:46.961030 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 10:39:46.961030 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 10:39:46.961030 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 10:39:46.961030 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 18 10:39:46.961030 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 10:39:46.961030 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-748281638 could not be found. Jul 18 10:39:46.962589 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi Jul 18 10:39:46.962589 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:39:46.962589 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi Jul 18 10:39:46.962589 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:39:46.962589 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:39:46.962589 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:39:46.962589 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 10:39:46.962589 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 10:39:46.962589 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-748281638 could not be found. Jul 18 10:39:46.962589 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi Jul 18 10:39:46.962589 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-e9e89e4e-8365-45f3-9b23-46fdc2ca2b77 tempest-VolumesNegativeTest-586540144 tempest-VolumesNegativeTest-586540144-project] Returning 404 to user: Volume tempest-invalid-748281638 could not be found. {{(pid=117879) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 10:39:46.962589 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-e9e89e4e-8365-45f3-9b23-46fdc2ca2b77 tempest-VolumesNegativeTest-586540144 tempest-VolumesNegativeTest-586540144-project] 10.222.0.33 "DELETE /compute/v2.1/os-volumes/tempest-invalid-748281638" status: 404 len: 98 microversion: 2.1 time: 0.036637 Jul 18 10:39:46.962589 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 546/1085] 10.222.0.33 () {58 vars in 1214 bytes} [Mon Jul 18 10:39:46 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-748281638 => generated 98 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 18 10:39:46.973308 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-40403d4f-ae35-4e1c-bb5b-8ffab635f404 tempest-VolumesNegativeTest-586540144 tempest-VolumesNegativeTest-586540144-project] 10.222.0.33 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003695 Jul 18 10:39:46.973766 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 540/1086] 10.222.0.33 () {58 vars in 1139 bytes} [Mon Jul 18 10:39:46 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 18 10:39:46.982110 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-26c4f0bb-7f3e-42e7-bdf3-56663b8d9a97 tempest-VolumesNegativeTest-586540144 tempest-VolumesNegativeTest-586540144-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003942 Jul 18 10:39:46.982718 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 547/1087] 10.222.0.33 () {58 vars in 1136 bytes} [Mon Jul 18 10:39:46 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 18 10:39:46.990919 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-975a11eb-687a-4b80-aae4-466577ba8211 tempest-VolumesNegativeTest-586540144 tempest-VolumesNegativeTest-586540144-project] Calling method '.version_select at 0x7f9f4a21e670>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:39:47.018262 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.wsgi [None req-975a11eb-687a-4b80-aae4-466577ba8211 tempest-VolumesNegativeTest-586540144 tempest-VolumesNegativeTest-586540144-project] HTTP exception thrown: Volume b1076018-2c89-47b6-b1f1-b4e9cb2952e2 could not be found. Jul 18 10:39:47.020341 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-975a11eb-687a-4b80-aae4-466577ba8211 tempest-VolumesNegativeTest-586540144 tempest-VolumesNegativeTest-586540144-project] Request method failure captured: Jul 18 10:39:47.020341 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: request: DELETE /compute/v2.1/os-volumes/b1076018-2c89-47b6-b1f1-b4e9cb2952e2 HTTP/1.1 Jul 18 10:39:47.020341 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: Accept: application/json Jul 18 10:39:47.020341 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: Accept-Encoding: identity Jul 18 10:39:47.020341 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: Connection: close Jul 18 10:39:47.020341 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: Content-Length: 0 Jul 18 10:39:47.020341 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: Content-Type: application/json Jul 18 10:39:47.020341 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: Host: 10.222.0.33 Jul 18 10:39:47.020341 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: Openstack-System-Scope: None Jul 18 10:39:47.020341 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: User-Agent: python-urllib3/1.26.9 Jul 18 10:39:47.020341 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Auth-Token: gAAAAABi1ThymiB1pklVWZDaHAOM7KLOcTL9_HmgOZdFSQ94TopAQt2gw1hNG_4ga67S_GE7SHIPpBby-hWB5x5Z1-vKefXkU8PczdlCcOY5OmXIItR9BPCTGHYlxwaSuszN-fri0Opg_ZB0mppdInKMNNPK8R1es7MWVn39jAsqH5MAsNZWtO0 Jul 18 10:39:47.020341 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Domain-Id: None Jul 18 10:39:47.020341 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Domain-Name: None Jul 18 10:39:47.020341 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Identity-Status: Confirmed Jul 18 10:39:47.020341 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Is-Admin-Project: True Jul 18 10:39:47.020341 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Project-Domain-Id: default Jul 18 10:39:47.020341 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Project-Domain-Name: Default Jul 18 10:39:47.020341 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Project-Id: 9d61432080064383bc2629af75576900 Jul 18 10:39:47.020341 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Project-Name: tempest-VolumesNegativeTest-586540144 Jul 18 10:39:47.020341 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Role: member,reader Jul 18 10:39:47.020341 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Roles: member,reader Jul 18 10:39:47.022018 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/9d61432080064383bc2629af75576900"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/9d61432080064383bc2629af75576900"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/9d61432080064383bc2629af75576900"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_9d61432080064383bc2629af75576900"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jul 18 10:39:47.022018 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Tenant: tempest-VolumesNegativeTest-586540144 Jul 18 10:39:47.022018 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Tenant-Id: 9d61432080064383bc2629af75576900 Jul 18 10:39:47.022018 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Tenant-Name: tempest-VolumesNegativeTest-586540144 Jul 18 10:39:47.022018 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-User: tempest-VolumesNegativeTest-586540144-project Jul 18 10:39:47.022018 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-User-Domain-Id: default Jul 18 10:39:47.022018 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-User-Domain-Name: Default Jul 18 10:39:47.022018 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-User-Id: 5b7396918821425392a2c93d5191ec7c Jul 18 10:39:47.022018 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-User-Name: tempest-VolumesNegativeTest-586540144-project Jul 18 10:39:47.022018 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: method: Jul 18 10:39:47.022018 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: exception: Volume b1076018-2c89-47b6-b1f1-b4e9cb2952e2 could not be found. Jul 18 10:39:47.022018 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: action_args: {'id': 'b1076018-2c89-47b6-b1f1-b4e9cb2952e2'} Jul 18 10:39:47.022018 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 10:39:47.023043 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:39:47.023043 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 18 10:39:47.023043 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 18 10:39:47.023043 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 18 10:39:47.023043 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 18 10:39:47.023043 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 18 10:39:47.023043 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 18 10:39:47.023043 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 18 10:39:47.023043 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 18 10:39:47.023043 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 18 10:39:47.023043 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 18 10:39:47.023043 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 18 10:39:47.023043 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 18 10:39:47.023043 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 18 10:39:47.023043 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 18 10:39:47.023043 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume b1076018-2c89-47b6-b1f1-b4e9cb2952e2 could not be found. (HTTP 404) (Request-ID: req-6c76f787-0682-4e2b-8f4e-77df2f91d3e3) Jul 18 10:39:47.023043 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi Jul 18 10:39:47.023043 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:39:47.023043 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi Jul 18 10:39:47.024265 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:39:47.024265 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 18 10:39:47.024265 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 18 10:39:47.024265 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 18 10:39:47.024265 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 18 10:39:47.024265 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 18 10:39:47.024265 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 18 10:39:47.024265 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 18 10:39:47.024265 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 18 10:39:47.024265 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 18 10:39:47.024265 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 18 10:39:47.024265 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 18 10:39:47.024265 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 18 10:39:47.024265 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 18 10:39:47.024265 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 18 10:39:47.024265 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 18 10:39:47.024265 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 18 10:39:47.024265 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 18 10:39:47.024265 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 18 10:39:47.025457 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 18 10:39:47.025457 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 18 10:39:47.025457 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 18 10:39:47.025457 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 18 10:39:47.025457 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume b1076018-2c89-47b6-b1f1-b4e9cb2952e2 could not be found. Jul 18 10:39:47.025457 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi Jul 18 10:39:47.025457 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:39:47.025457 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi Jul 18 10:39:47.025457 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:39:47.025457 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:39:47.025457 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:39:47.025457 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 10:39:47.025457 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 10:39:47.025457 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 10:39:47.025457 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 10:39:47.025457 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 10:39:47.025457 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 10:39:47.025457 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 18 10:39:47.025457 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 10:39:47.026994 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume b1076018-2c89-47b6-b1f1-b4e9cb2952e2 could not be found. Jul 18 10:39:47.026994 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi Jul 18 10:39:47.026994 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:39:47.026994 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi Jul 18 10:39:47.026994 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:39:47.026994 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:39:47.026994 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:39:47.026994 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 10:39:47.026994 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 10:39:47.026994 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume b1076018-2c89-47b6-b1f1-b4e9cb2952e2 could not be found. Jul 18 10:39:47.026994 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi Jul 18 10:39:47.026994 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-975a11eb-687a-4b80-aae4-466577ba8211 tempest-VolumesNegativeTest-586540144 tempest-VolumesNegativeTest-586540144-project] Returning 404 to user: Volume b1076018-2c89-47b6-b1f1-b4e9cb2952e2 could not be found. {{(pid=117880) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 10:39:47.026994 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-975a11eb-687a-4b80-aae4-466577ba8211 tempest-VolumesNegativeTest-586540144 tempest-VolumesNegativeTest-586540144-project] 10.222.0.33 "DELETE /compute/v2.1/os-volumes/b1076018-2c89-47b6-b1f1-b4e9cb2952e2" status: 404 len: 109 microversion: 2.1 time: 0.034322 Jul 18 10:39:47.026994 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 541/1088] 10.222.0.33 () {58 vars in 1247 bytes} [Mon Jul 18 10:39:46 2022] DELETE /compute/v2.1/os-volumes/b1076018-2c89-47b6-b1f1-b4e9cb2952e2 => generated 109 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 10:39:47.031637 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-daf98923-db14-42dd-bb3f-6b374c82f14a tempest-VolumesNegativeTest-586540144 tempest-VolumesNegativeTest-586540144-project] Calling method '.version_select at 0x7f9f4a086040>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:39:47.059097 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.wsgi [None req-daf98923-db14-42dd-bb3f-6b374c82f14a tempest-VolumesNegativeTest-586540144 tempest-VolumesNegativeTest-586540144-project] HTTP exception thrown: Volume 68a46a12-cbf2-4f1f-a5bb-98e60dde4eb4 could not be found. Jul 18 10:39:47.061174 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-daf98923-db14-42dd-bb3f-6b374c82f14a tempest-VolumesNegativeTest-586540144 tempest-VolumesNegativeTest-586540144-project] Request method failure captured: Jul 18 10:39:47.061174 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: request: GET /compute/v2.1/os-volumes/68a46a12-cbf2-4f1f-a5bb-98e60dde4eb4 HTTP/1.1 Jul 18 10:39:47.061174 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: Accept: application/json Jul 18 10:39:47.061174 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: Accept-Encoding: identity Jul 18 10:39:47.061174 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: Connection: close Jul 18 10:39:47.061174 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: Content-Length: 0 Jul 18 10:39:47.061174 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: Content-Type: application/json Jul 18 10:39:47.061174 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: Host: 10.222.0.33 Jul 18 10:39:47.061174 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: Openstack-System-Scope: None Jul 18 10:39:47.061174 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: User-Agent: python-urllib3/1.26.9 Jul 18 10:39:47.061174 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Auth-Token: gAAAAABi1ThymiB1pklVWZDaHAOM7KLOcTL9_HmgOZdFSQ94TopAQt2gw1hNG_4ga67S_GE7SHIPpBby-hWB5x5Z1-vKefXkU8PczdlCcOY5OmXIItR9BPCTGHYlxwaSuszN-fri0Opg_ZB0mppdInKMNNPK8R1es7MWVn39jAsqH5MAsNZWtO0 Jul 18 10:39:47.061174 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Domain-Id: None Jul 18 10:39:47.061174 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Domain-Name: None Jul 18 10:39:47.061174 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Identity-Status: Confirmed Jul 18 10:39:47.061174 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Is-Admin-Project: True Jul 18 10:39:47.061174 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Project-Domain-Id: default Jul 18 10:39:47.061174 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Project-Domain-Name: Default Jul 18 10:39:47.061174 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Project-Id: 9d61432080064383bc2629af75576900 Jul 18 10:39:47.061174 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Project-Name: tempest-VolumesNegativeTest-586540144 Jul 18 10:39:47.061174 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Role: member,reader Jul 18 10:39:47.061174 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Roles: member,reader Jul 18 10:39:47.062824 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/9d61432080064383bc2629af75576900"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/9d61432080064383bc2629af75576900"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/9d61432080064383bc2629af75576900"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_9d61432080064383bc2629af75576900"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jul 18 10:39:47.062824 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Tenant: tempest-VolumesNegativeTest-586540144 Jul 18 10:39:47.062824 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Tenant-Id: 9d61432080064383bc2629af75576900 Jul 18 10:39:47.062824 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Tenant-Name: tempest-VolumesNegativeTest-586540144 Jul 18 10:39:47.062824 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-User: tempest-VolumesNegativeTest-586540144-project Jul 18 10:39:47.062824 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-User-Domain-Id: default Jul 18 10:39:47.062824 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-User-Domain-Name: Default Jul 18 10:39:47.062824 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-User-Id: 5b7396918821425392a2c93d5191ec7c Jul 18 10:39:47.062824 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-User-Name: tempest-VolumesNegativeTest-586540144-project Jul 18 10:39:47.062824 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: method: Jul 18 10:39:47.062824 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: exception: Volume 68a46a12-cbf2-4f1f-a5bb-98e60dde4eb4 could not be found. Jul 18 10:39:47.062824 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: action_args: {'id': '68a46a12-cbf2-4f1f-a5bb-98e60dde4eb4'} Jul 18 10:39:47.062824 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 10:39:47.063715 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:39:47.063715 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 18 10:39:47.063715 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 18 10:39:47.063715 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 18 10:39:47.063715 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 18 10:39:47.063715 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 18 10:39:47.063715 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 18 10:39:47.063715 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 18 10:39:47.063715 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 18 10:39:47.063715 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 18 10:39:47.063715 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 18 10:39:47.063715 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 18 10:39:47.063715 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 18 10:39:47.063715 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 18 10:39:47.063715 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 18 10:39:47.063715 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 68a46a12-cbf2-4f1f-a5bb-98e60dde4eb4 could not be found. (HTTP 404) (Request-ID: req-80489dc2-11dd-49c6-9457-6ee572ad3c8e) Jul 18 10:39:47.063715 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi Jul 18 10:39:47.063715 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:39:47.063715 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi Jul 18 10:39:47.065299 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:39:47.065299 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 18 10:39:47.065299 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 18 10:39:47.065299 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 18 10:39:47.065299 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 18 10:39:47.065299 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 18 10:39:47.065299 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 18 10:39:47.065299 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 18 10:39:47.065299 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 18 10:39:47.065299 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 18 10:39:47.065299 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 18 10:39:47.065299 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 18 10:39:47.065299 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 18 10:39:47.065299 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 18 10:39:47.065299 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 18 10:39:47.065299 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 18 10:39:47.065299 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 18 10:39:47.065299 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 18 10:39:47.065299 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 18 10:39:47.066742 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 18 10:39:47.066742 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 18 10:39:47.066742 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 18 10:39:47.066742 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 18 10:39:47.066742 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 68a46a12-cbf2-4f1f-a5bb-98e60dde4eb4 could not be found. Jul 18 10:39:47.066742 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi Jul 18 10:39:47.066742 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:39:47.066742 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi Jul 18 10:39:47.066742 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:39:47.066742 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:39:47.066742 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:39:47.066742 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 10:39:47.066742 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 10:39:47.066742 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 10:39:47.066742 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 10:39:47.066742 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 10:39:47.066742 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 10:39:47.066742 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 18 10:39:47.066742 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 10:39:47.068187 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 68a46a12-cbf2-4f1f-a5bb-98e60dde4eb4 could not be found. Jul 18 10:39:47.068187 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi Jul 18 10:39:47.068187 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:39:47.068187 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi Jul 18 10:39:47.068187 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:39:47.068187 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:39:47.068187 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:39:47.068187 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 10:39:47.068187 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 10:39:47.068187 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 68a46a12-cbf2-4f1f-a5bb-98e60dde4eb4 could not be found. Jul 18 10:39:47.068187 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi Jul 18 10:39:47.068187 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-daf98923-db14-42dd-bb3f-6b374c82f14a tempest-VolumesNegativeTest-586540144 tempest-VolumesNegativeTest-586540144-project] Returning 404 to user: Volume 68a46a12-cbf2-4f1f-a5bb-98e60dde4eb4 could not be found. {{(pid=117879) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 10:39:47.068187 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-daf98923-db14-42dd-bb3f-6b374c82f14a tempest-VolumesNegativeTest-586540144 tempest-VolumesNegativeTest-586540144-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/68a46a12-cbf2-4f1f-a5bb-98e60dde4eb4" status: 404 len: 109 microversion: 2.1 time: 0.035215 Jul 18 10:39:47.068187 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 548/1089] 10.222.0.33 () {58 vars in 1244 bytes} [Mon Jul 18 10:39:47 2022] GET /compute/v2.1/os-volumes/68a46a12-cbf2-4f1f-a5bb-98e60dde4eb4 => generated 109 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 18 10:39:47.227716 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-ab6c48d3-bcde-47f2-8550-1ea8b665c727 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:39:47.228686 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-ab6c48d3-bcde-47f2-8550-1ea8b665c727 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] [instance: 6e2ab0bb-d92f-4441-bdea-2bc427e441f8] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:39:47.235742 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-ab6c48d3-bcde-47f2-8550-1ea8b665c727 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:39:47.236813 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-ab6c48d3-bcde-47f2-8550-1ea8b665c727 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:39:47.236970 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-ab6c48d3-bcde-47f2-8550-1ea8b665c727 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:39:47.237397 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-ab6c48d3-bcde-47f2-8550-1ea8b665c727 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:39:47.389305 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-ab6c48d3-bcde-47f2-8550-1ea8b665c727 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9eb8d188e040bca894e038955f2402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c656b71bbd447cba7d11335c928dfda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:39:47.397361 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-ab6c48d3-bcde-47f2-8550-1ea8b665c727 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] 10.222.0.33 "GET /compute/v2.1/servers/6e2ab0bb-d92f-4441-bdea-2bc427e441f8" status: 200 len: 1575 microversion: 2.1 time: 0.173888 Jul 18 10:39:47.398261 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 542/1090] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:39:47 2022] GET /compute/v2.1/servers/6e2ab0bb-d92f-4441-bdea-2bc427e441f8 => generated 1575 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:39:48.351605 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [req-80d3319b-8069-4dea-b88a-29873d870681 req-75bf7cf1-7ee6-42a8-9282-717be488eb37 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e2ab0bb-d92f-4441-bdea-2bc427e441f8", "name": "network-vif-deleted", "tag": "9c584805-1812-494e-8d2b-019452f06e9c"}]} {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:39:48.360933 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [req-80d3319b-8069-4dea-b88a-29873d870681 req-75bf7cf1-7ee6-42a8-9282-717be488eb37 service nova] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:39:48.361420 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [req-80d3319b-8069-4dea-b88a-29873d870681 req-75bf7cf1-7ee6-42a8-9282-717be488eb37 service nova] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:39:48.380742 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.compute.server_external_events [req-80d3319b-8069-4dea-b88a-29873d870681 req-75bf7cf1-7ee6-42a8-9282-717be488eb37 service nova] Creating event network-vif-deleted:9c584805-1812-494e-8d2b-019452f06e9c for instance 6e2ab0bb-d92f-4441-bdea-2bc427e441f8 on hv-cinder-83754 Jul 18 10:39:48.385806 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [req-80d3319b-8069-4dea-b88a-29873d870681 req-75bf7cf1-7ee6-42a8-9282-717be488eb37 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038883 Jul 18 10:39:48.386388 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 549/1091] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jul 18 10:39:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:39:48.416319 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-2680326d-7ced-41d9-8656-9b8d9ff06af2 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:39:48.417173 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-2680326d-7ced-41d9-8656-9b8d9ff06af2 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] [instance: 6e2ab0bb-d92f-4441-bdea-2bc427e441f8] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:39:48.428087 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-2680326d-7ced-41d9-8656-9b8d9ff06af2 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:39:48.428479 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-2680326d-7ced-41d9-8656-9b8d9ff06af2 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:39:48.429292 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-2680326d-7ced-41d9-8656-9b8d9ff06af2 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:39:48.429849 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-2680326d-7ced-41d9-8656-9b8d9ff06af2 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:39:48.494262 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-2680326d-7ced-41d9-8656-9b8d9ff06af2 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9eb8d188e040bca894e038955f2402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c656b71bbd447cba7d11335c928dfda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:39:48.502091 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-2680326d-7ced-41d9-8656-9b8d9ff06af2 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] 10.222.0.33 "GET /compute/v2.1/servers/6e2ab0bb-d92f-4441-bdea-2bc427e441f8" status: 200 len: 1224 microversion: 2.1 time: 0.089530 Jul 18 10:39:48.502658 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 543/1092] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:39:48 2022] GET /compute/v2.1/servers/6e2ab0bb-d92f-4441-bdea-2bc427e441f8 => generated 1224 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:39:49.523845 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-fdcc33d8-6b48-4982-add2-1e7bd6ebe48b tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:39:49.524725 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-fdcc33d8-6b48-4982-add2-1e7bd6ebe48b tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] [instance: 6e2ab0bb-d92f-4441-bdea-2bc427e441f8] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:39:49.531679 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-fdcc33d8-6b48-4982-add2-1e7bd6ebe48b tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:39:49.532138 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-fdcc33d8-6b48-4982-add2-1e7bd6ebe48b tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:39:49.532952 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-fdcc33d8-6b48-4982-add2-1e7bd6ebe48b tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:39:49.533398 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-fdcc33d8-6b48-4982-add2-1e7bd6ebe48b tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:39:49.546551 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.wsgi [None req-fdcc33d8-6b48-4982-add2-1e7bd6ebe48b tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] HTTP exception thrown: Instance 6e2ab0bb-d92f-4441-bdea-2bc427e441f8 could not be found. Jul 18 10:39:49.548199 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-fdcc33d8-6b48-4982-add2-1e7bd6ebe48b tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Request method failure captured: Jul 18 10:39:49.548199 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: request: GET /compute/v2.1/servers/6e2ab0bb-d92f-4441-bdea-2bc427e441f8 HTTP/1.1 Jul 18 10:39:49.548199 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: Accept: application/json Jul 18 10:39:49.548199 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: Accept-Encoding: identity Jul 18 10:39:49.548199 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: Connection: close Jul 18 10:39:49.548199 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: Content-Length: 0 Jul 18 10:39:49.548199 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: Content-Type: application/json Jul 18 10:39:49.548199 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: Host: 10.222.0.33 Jul 18 10:39:49.548199 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: Openstack-System-Scope: None Jul 18 10:39:49.548199 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: User-Agent: python-urllib3/1.26.9 Jul 18 10:39:49.548199 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Auth-Token: gAAAAABi1Ta7jUVddA4lAkYQOSn5ba4GUqIUnjCcEqF4pQxl-GEznssUVevgvZpkX6wQZnZIi_fUKggUhA3ggfdR-HT6czJuyYKZ7rf0YtZlULyLd1O6aYbOL68zIP4nma5o985FLbJEtPDh_LavK9gjeR0JtBZAYixbhp1H5pGtnwKvIXY--Bw Jul 18 10:39:49.548199 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Domain-Id: None Jul 18 10:39:49.548199 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Domain-Name: None Jul 18 10:39:49.548199 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Identity-Status: Confirmed Jul 18 10:39:49.548199 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Is-Admin-Project: True Jul 18 10:39:49.548199 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Project-Domain-Id: default Jul 18 10:39:49.548199 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Project-Domain-Name: Default Jul 18 10:39:49.548199 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Project-Id: 2c656b71bbd447cba7d11335c928dfda Jul 18 10:39:49.548199 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Project-Name: tempest-TestVolumeBootPattern-248550394 Jul 18 10:39:49.548199 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Role: member,reader Jul 18 10:39:49.548199 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Roles: member,reader Jul 18 10:39:49.549917 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/2c656b71bbd447cba7d11335c928dfda"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/2c656b71bbd447cba7d11335c928dfda"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/2c656b71bbd447cba7d11335c928dfda"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_2c656b71bbd447cba7d11335c928dfda"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jul 18 10:39:49.549917 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Tenant: tempest-TestVolumeBootPattern-248550394 Jul 18 10:39:49.549917 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Tenant-Id: 2c656b71bbd447cba7d11335c928dfda Jul 18 10:39:49.549917 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Tenant-Name: tempest-TestVolumeBootPattern-248550394 Jul 18 10:39:49.549917 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-User: tempest-TestVolumeBootPattern-248550394-project Jul 18 10:39:49.549917 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-User-Domain-Id: default Jul 18 10:39:49.549917 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-User-Domain-Name: Default Jul 18 10:39:49.549917 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-User-Id: 4e9eb8d188e040bca894e038955f2402 Jul 18 10:39:49.549917 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-User-Name: tempest-TestVolumeBootPattern-248550394-project Jul 18 10:39:49.549917 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: method: > Jul 18 10:39:49.549917 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: exception: Instance 6e2ab0bb-d92f-4441-bdea-2bc427e441f8 could not be found. Jul 18 10:39:49.549917 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: action_args: {'id': '6e2ab0bb-d92f-4441-bdea-2bc427e441f8'} Jul 18 10:39:49.550911 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 10:39:49.550911 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:39:49.550911 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 10:39:49.550911 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 10:39:49.550911 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 10:39:49.550911 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 10:39:49.550911 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 10:39:49.550911 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 10:39:49.550911 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 10:39:49.550911 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 10:39:49.550911 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6e2ab0bb-d92f-4441-bdea-2bc427e441f8 could not be found. Jul 18 10:39:49.550911 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi Jul 18 10:39:49.550911 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:39:49.550911 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi Jul 18 10:39:49.550911 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:39:49.550911 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:39:49.550911 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:39:49.550911 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 10:39:49.550911 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 10:39:49.550911 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 10:39:49.552672 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 10:39:49.552672 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 10:39:49.552672 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 10:39:49.552672 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 10:39:49.552672 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 10:39:49.552672 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 10:39:49.552672 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 10:39:49.552672 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6e2ab0bb-d92f-4441-bdea-2bc427e441f8 could not be found. Jul 18 10:39:49.552672 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi Jul 18 10:39:49.552672 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:39:49.552672 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi Jul 18 10:39:49.552672 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:39:49.552672 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:39:49.552672 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:39:49.552672 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 10:39:49.552672 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 10:39:49.552672 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6e2ab0bb-d92f-4441-bdea-2bc427e441f8 could not be found. Jul 18 10:39:49.552672 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi Jul 18 10:39:49.554116 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-fdcc33d8-6b48-4982-add2-1e7bd6ebe48b tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Returning 404 to user: Instance 6e2ab0bb-d92f-4441-bdea-2bc427e441f8 could not be found. {{(pid=117879) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 10:39:49.554116 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-fdcc33d8-6b48-4982-add2-1e7bd6ebe48b tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] 10.222.0.33 "GET /compute/v2.1/servers/6e2ab0bb-d92f-4441-bdea-2bc427e441f8" status: 404 len: 111 microversion: 2.1 time: 0.032742 Jul 18 10:39:49.554116 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 550/1093] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:39:49 2022] GET /compute/v2.1/servers/6e2ab0bb-d92f-4441-bdea-2bc427e441f8 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 10:39:52.877404 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-dc138628-cbc5-45b3-9562-4a1ac7eddeb3 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:39:52.877987 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-dc138628-cbc5-45b3-9562-4a1ac7eddeb3 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] [instance: 0851efd6-d3b6-44d7-9b22-e327e1bca393] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:39:52.879602 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [req-93687772-07e5-42c1-938a-aaa7fab171c1 req-2e94b980-4b68-476c-8486-2f705e0825b8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0851efd6-d3b6-44d7-9b22-e327e1bca393", "tag": "ef589bb7-916e-48f9-bce4-fdf64f4ed1b1"}]} {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:39:52.884981 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-dc138628-cbc5-45b3-9562-4a1ac7eddeb3 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:39:52.885507 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-dc138628-cbc5-45b3-9562-4a1ac7eddeb3 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:39:52.886288 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-dc138628-cbc5-45b3-9562-4a1ac7eddeb3 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:39:52.886720 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-dc138628-cbc5-45b3-9562-4a1ac7eddeb3 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:39:52.889399 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [req-93687772-07e5-42c1-938a-aaa7fab171c1 req-2e94b980-4b68-476c-8486-2f705e0825b8 service nova] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:39:52.890092 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [req-93687772-07e5-42c1-938a-aaa7fab171c1 req-2e94b980-4b68-476c-8486-2f705e0825b8 service nova] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:39:52.902279 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.compute.server_external_events [req-93687772-07e5-42c1-938a-aaa7fab171c1 req-2e94b980-4b68-476c-8486-2f705e0825b8 service nova] Creating event network-changed:ef589bb7-916e-48f9-bce4-fdf64f4ed1b1 for instance 0851efd6-d3b6-44d7-9b22-e327e1bca393 on hv-cinder-83754 Jul 18 10:39:52.908429 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [req-93687772-07e5-42c1-938a-aaa7fab171c1 req-2e94b980-4b68-476c-8486-2f705e0825b8 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032576 Jul 18 10:39:52.909431 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 551/1094] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jul 18 10:39:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:39:52.912118 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-dc138628-cbc5-45b3-9562-4a1ac7eddeb3 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] [instance: 0851efd6-d3b6-44d7-9b22-e327e1bca393] Going to try to terminate instance {{(pid=117880) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 10:39:52.990085 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-dc138628-cbc5-45b3-9562-4a1ac7eddeb3 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] 10.222.0.33 "DELETE /compute/v2.1/servers/0851efd6-d3b6-44d7-9b22-e327e1bca393" status: 204 len: 0 microversion: 2.1 time: 0.116341 Jul 18 10:39:52.990599 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 544/1095] 10.222.0.33 () {58 vars in 1238 bytes} [Mon Jul 18 10:39:52 2022] DELETE /compute/v2.1/servers/0851efd6-d3b6-44d7-9b22-e327e1bca393 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 10:39:52.999891 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-286e5cb1-e263-4865-b7c0-d361fce8362f tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:39:53.000760 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-286e5cb1-e263-4865-b7c0-d361fce8362f tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] [instance: 0851efd6-d3b6-44d7-9b22-e327e1bca393] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:39:53.006899 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-286e5cb1-e263-4865-b7c0-d361fce8362f tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:39:53.007354 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-286e5cb1-e263-4865-b7c0-d361fce8362f tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:39:53.008119 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-286e5cb1-e263-4865-b7c0-d361fce8362f tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:39:53.008576 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-286e5cb1-e263-4865-b7c0-d361fce8362f tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:39:53.148016 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-286e5cb1-e263-4865-b7c0-d361fce8362f tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9eb8d188e040bca894e038955f2402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c656b71bbd447cba7d11335c928dfda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:39:53.156807 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-286e5cb1-e263-4865-b7c0-d361fce8362f tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] 10.222.0.33 "GET /compute/v2.1/servers/0851efd6-d3b6-44d7-9b22-e327e1bca393" status: 200 len: 1577 microversion: 2.1 time: 0.161693 Jul 18 10:39:53.158207 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 552/1096] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:39:52 2022] GET /compute/v2.1/servers/0851efd6-d3b6-44d7-9b22-e327e1bca393 => generated 1577 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:39:54.175070 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-f6c7e30a-8bbe-495e-9fea-b58de3baf5ee tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:39:54.175770 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-f6c7e30a-8bbe-495e-9fea-b58de3baf5ee tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] [instance: 0851efd6-d3b6-44d7-9b22-e327e1bca393] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:39:54.182209 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-f6c7e30a-8bbe-495e-9fea-b58de3baf5ee tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:39:54.182652 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-f6c7e30a-8bbe-495e-9fea-b58de3baf5ee tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:39:54.183414 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-f6c7e30a-8bbe-495e-9fea-b58de3baf5ee tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:39:54.183850 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-f6c7e30a-8bbe-495e-9fea-b58de3baf5ee tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:39:54.314252 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-f6c7e30a-8bbe-495e-9fea-b58de3baf5ee tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9eb8d188e040bca894e038955f2402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c656b71bbd447cba7d11335c928dfda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:39:54.321694 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-f6c7e30a-8bbe-495e-9fea-b58de3baf5ee tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] 10.222.0.33 "GET /compute/v2.1/servers/0851efd6-d3b6-44d7-9b22-e327e1bca393" status: 200 len: 1577 microversion: 2.1 time: 0.150773 Jul 18 10:39:54.322252 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 545/1097] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:39:54 2022] GET /compute/v2.1/servers/0851efd6-d3b6-44d7-9b22-e327e1bca393 => generated 1577 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:39:55.337989 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-adb232fd-6c46-4c32-9d31-c4338659d02e tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:39:55.338551 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-adb232fd-6c46-4c32-9d31-c4338659d02e tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] [instance: 0851efd6-d3b6-44d7-9b22-e327e1bca393] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:39:55.345489 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-adb232fd-6c46-4c32-9d31-c4338659d02e tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:39:55.345975 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-adb232fd-6c46-4c32-9d31-c4338659d02e tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:39:55.346743 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-adb232fd-6c46-4c32-9d31-c4338659d02e tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:39:55.347181 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-adb232fd-6c46-4c32-9d31-c4338659d02e tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:39:55.487703 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.policy [None req-adb232fd-6c46-4c32-9d31-c4338659d02e tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9eb8d188e040bca894e038955f2402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c656b71bbd447cba7d11335c928dfda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117879) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:39:55.495515 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-adb232fd-6c46-4c32-9d31-c4338659d02e tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] 10.222.0.33 "GET /compute/v2.1/servers/0851efd6-d3b6-44d7-9b22-e327e1bca393" status: 200 len: 1577 microversion: 2.1 time: 0.161443 Jul 18 10:39:55.496112 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 553/1098] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:39:55 2022] GET /compute/v2.1/servers/0851efd6-d3b6-44d7-9b22-e327e1bca393 => generated 1577 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:39:56.512702 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-effcd6ca-6a61-4353-8121-32cd2d643c2e tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:39:56.513241 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-effcd6ca-6a61-4353-8121-32cd2d643c2e tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] [instance: 0851efd6-d3b6-44d7-9b22-e327e1bca393] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:39:56.519692 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-effcd6ca-6a61-4353-8121-32cd2d643c2e tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:39:56.520140 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-effcd6ca-6a61-4353-8121-32cd2d643c2e tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:39:56.521051 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-effcd6ca-6a61-4353-8121-32cd2d643c2e tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:39:56.521487 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-effcd6ca-6a61-4353-8121-32cd2d643c2e tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:39:56.784023 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-effcd6ca-6a61-4353-8121-32cd2d643c2e tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9eb8d188e040bca894e038955f2402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c656b71bbd447cba7d11335c928dfda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:39:56.791479 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-effcd6ca-6a61-4353-8121-32cd2d643c2e tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] 10.222.0.33 "GET /compute/v2.1/servers/0851efd6-d3b6-44d7-9b22-e327e1bca393" status: 200 len: 1577 microversion: 2.1 time: 0.282665 Jul 18 10:39:56.792038 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 546/1099] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:39:56 2022] GET /compute/v2.1/servers/0851efd6-d3b6-44d7-9b22-e327e1bca393 => generated 1577 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:39:57.221080 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [req-c00ca986-39e9-4e81-9d6e-cae0b7ed4680 req-ed0b3dc7-8346-48a8-8a3a-0efb291375c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0851efd6-d3b6-44d7-9b22-e327e1bca393", "name": "network-vif-deleted", "tag": "ef589bb7-916e-48f9-bce4-fdf64f4ed1b1"}]} {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:39:57.230420 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [req-c00ca986-39e9-4e81-9d6e-cae0b7ed4680 req-ed0b3dc7-8346-48a8-8a3a-0efb291375c8 service nova] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:39:57.230869 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [req-c00ca986-39e9-4e81-9d6e-cae0b7ed4680 req-ed0b3dc7-8346-48a8-8a3a-0efb291375c8 service nova] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:39:57.242078 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.compute.server_external_events [req-c00ca986-39e9-4e81-9d6e-cae0b7ed4680 req-ed0b3dc7-8346-48a8-8a3a-0efb291375c8 service nova] Creating event network-vif-deleted:ef589bb7-916e-48f9-bce4-fdf64f4ed1b1 for instance 0851efd6-d3b6-44d7-9b22-e327e1bca393 on hv-cinder-83754 Jul 18 10:39:57.247821 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [req-c00ca986-39e9-4e81-9d6e-cae0b7ed4680 req-ed0b3dc7-8346-48a8-8a3a-0efb291375c8 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031008 Jul 18 10:39:57.248407 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 554/1100] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jul 18 10:39:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:39:57.810325 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-3b21c540-70f9-495c-8ec6-2e1843c2b3f6 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:39:57.810938 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-3b21c540-70f9-495c-8ec6-2e1843c2b3f6 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] [instance: 0851efd6-d3b6-44d7-9b22-e327e1bca393] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:39:57.817909 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-3b21c540-70f9-495c-8ec6-2e1843c2b3f6 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:39:57.818359 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-3b21c540-70f9-495c-8ec6-2e1843c2b3f6 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:39:57.819124 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-3b21c540-70f9-495c-8ec6-2e1843c2b3f6 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:39:57.819551 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-3b21c540-70f9-495c-8ec6-2e1843c2b3f6 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:39:57.849559 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-3b21c540-70f9-495c-8ec6-2e1843c2b3f6 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:39:57.850004 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-3b21c540-70f9-495c-8ec6-2e1843c2b3f6 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:39:57.850444 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.objects.instance [None req-3b21c540-70f9-495c-8ec6-2e1843c2b3f6 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Lazy-loading 'fault' on Instance uuid 0851efd6-d3b6-44d7-9b22-e327e1bca393 {{(pid=117880) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 10:39:57.897628 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.policy [None req-3b21c540-70f9-495c-8ec6-2e1843c2b3f6 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9eb8d188e040bca894e038955f2402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c656b71bbd447cba7d11335c928dfda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117880) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:39:57.905018 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-3b21c540-70f9-495c-8ec6-2e1843c2b3f6 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] 10.222.0.33 "GET /compute/v2.1/servers/0851efd6-d3b6-44d7-9b22-e327e1bca393" status: 200 len: 1184 microversion: 2.1 time: 0.099706 Jul 18 10:39:57.905588 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 547/1101] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:39:57 2022] GET /compute/v2.1/servers/0851efd6-d3b6-44d7-9b22-e327e1bca393 => generated 1184 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:39:58.924165 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-9323a9dd-fbc9-4cec-a05f-8139b56ab933 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:39:58.925060 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-9323a9dd-fbc9-4cec-a05f-8139b56ab933 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] [instance: 0851efd6-d3b6-44d7-9b22-e327e1bca393] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:39:58.931994 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-9323a9dd-fbc9-4cec-a05f-8139b56ab933 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:39:58.932552 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-9323a9dd-fbc9-4cec-a05f-8139b56ab933 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:39:58.933339 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-9323a9dd-fbc9-4cec-a05f-8139b56ab933 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:39:58.933774 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-9323a9dd-fbc9-4cec-a05f-8139b56ab933 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:39:58.949766 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.wsgi [None req-9323a9dd-fbc9-4cec-a05f-8139b56ab933 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] HTTP exception thrown: Instance 0851efd6-d3b6-44d7-9b22-e327e1bca393 could not be found. Jul 18 10:39:58.951499 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-9323a9dd-fbc9-4cec-a05f-8139b56ab933 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Request method failure captured: Jul 18 10:39:58.951499 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: request: GET /compute/v2.1/servers/0851efd6-d3b6-44d7-9b22-e327e1bca393 HTTP/1.1 Jul 18 10:39:58.951499 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: Accept: application/json Jul 18 10:39:58.951499 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: Accept-Encoding: identity Jul 18 10:39:58.951499 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: Connection: close Jul 18 10:39:58.951499 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: Content-Length: 0 Jul 18 10:39:58.951499 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: Content-Type: application/json Jul 18 10:39:58.951499 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: Host: 10.222.0.33 Jul 18 10:39:58.951499 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: Openstack-System-Scope: None Jul 18 10:39:58.951499 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: User-Agent: python-urllib3/1.26.9 Jul 18 10:39:58.951499 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Auth-Token: gAAAAABi1Ta7jUVddA4lAkYQOSn5ba4GUqIUnjCcEqF4pQxl-GEznssUVevgvZpkX6wQZnZIi_fUKggUhA3ggfdR-HT6czJuyYKZ7rf0YtZlULyLd1O6aYbOL68zIP4nma5o985FLbJEtPDh_LavK9gjeR0JtBZAYixbhp1H5pGtnwKvIXY--Bw Jul 18 10:39:58.951499 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Domain-Id: None Jul 18 10:39:58.951499 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Domain-Name: None Jul 18 10:39:58.951499 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Identity-Status: Confirmed Jul 18 10:39:58.951499 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Is-Admin-Project: True Jul 18 10:39:58.951499 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Project-Domain-Id: default Jul 18 10:39:58.951499 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Project-Domain-Name: Default Jul 18 10:39:58.951499 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Project-Id: 2c656b71bbd447cba7d11335c928dfda Jul 18 10:39:58.951499 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Project-Name: tempest-TestVolumeBootPattern-248550394 Jul 18 10:39:58.951499 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Role: member,reader Jul 18 10:39:58.951499 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Roles: member,reader Jul 18 10:39:58.954664 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/2c656b71bbd447cba7d11335c928dfda"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/2c656b71bbd447cba7d11335c928dfda"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/2c656b71bbd447cba7d11335c928dfda"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_2c656b71bbd447cba7d11335c928dfda"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jul 18 10:39:58.954664 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Tenant: tempest-TestVolumeBootPattern-248550394 Jul 18 10:39:58.954664 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Tenant-Id: 2c656b71bbd447cba7d11335c928dfda Jul 18 10:39:58.954664 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Tenant-Name: tempest-TestVolumeBootPattern-248550394 Jul 18 10:39:58.954664 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-User: tempest-TestVolumeBootPattern-248550394-project Jul 18 10:39:58.954664 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-User-Domain-Id: default Jul 18 10:39:58.954664 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-User-Domain-Name: Default Jul 18 10:39:58.954664 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-User-Id: 4e9eb8d188e040bca894e038955f2402 Jul 18 10:39:58.954664 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-User-Name: tempest-TestVolumeBootPattern-248550394-project Jul 18 10:39:58.954664 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: method: > Jul 18 10:39:58.954664 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: exception: Instance 0851efd6-d3b6-44d7-9b22-e327e1bca393 could not be found. Jul 18 10:39:58.954664 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: action_args: {'id': '0851efd6-d3b6-44d7-9b22-e327e1bca393'} Jul 18 10:39:58.955857 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 10:39:58.955857 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:39:58.955857 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 10:39:58.955857 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 10:39:58.955857 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 10:39:58.955857 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 10:39:58.955857 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 10:39:58.955857 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 10:39:58.955857 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 10:39:58.955857 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 10:39:58.955857 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0851efd6-d3b6-44d7-9b22-e327e1bca393 could not be found. Jul 18 10:39:58.955857 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi Jul 18 10:39:58.955857 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:39:58.955857 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi Jul 18 10:39:58.955857 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:39:58.955857 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:39:58.955857 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:39:58.955857 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 10:39:58.955857 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 10:39:58.955857 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 10:39:58.957814 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 10:39:58.957814 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 10:39:58.957814 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 10:39:58.957814 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 10:39:58.957814 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 10:39:58.957814 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 10:39:58.957814 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 10:39:58.957814 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0851efd6-d3b6-44d7-9b22-e327e1bca393 could not be found. Jul 18 10:39:58.957814 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi Jul 18 10:39:58.957814 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:39:58.957814 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi Jul 18 10:39:58.957814 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:39:58.957814 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:39:58.957814 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:39:58.957814 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 10:39:58.957814 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 10:39:58.957814 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0851efd6-d3b6-44d7-9b22-e327e1bca393 could not be found. Jul 18 10:39:58.957814 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi Jul 18 10:39:58.959221 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-9323a9dd-fbc9-4cec-a05f-8139b56ab933 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Returning 404 to user: Instance 0851efd6-d3b6-44d7-9b22-e327e1bca393 could not be found. {{(pid=117879) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 10:39:58.959221 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-9323a9dd-fbc9-4cec-a05f-8139b56ab933 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] 10.222.0.33 "GET /compute/v2.1/servers/0851efd6-d3b6-44d7-9b22-e327e1bca393" status: 404 len: 111 microversion: 2.1 time: 0.035788 Jul 18 10:39:58.959221 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 555/1102] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:39:58 2022] GET /compute/v2.1/servers/0851efd6-d3b6-44d7-9b22-e327e1bca393 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 10:39:59.423954 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-fa141f60-1414-44cc-ba37-e69359472e29 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Calling method '>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:39:59.424476 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.compute.api [None req-fa141f60-1414-44cc-ba37-e69359472e29 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] [instance: 22a03003-3677-426e-8fb8-5b58998eef8a] Fetching instance by UUID {{(pid=117880) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:39:59.431027 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-fa141f60-1414-44cc-ba37-e69359472e29 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:39:59.431483 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-fa141f60-1414-44cc-ba37-e69359472e29 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:39:59.432254 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-fa141f60-1414-44cc-ba37-e69359472e29 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:39:59.432731 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG oslo_concurrency.lockutils [None req-fa141f60-1414-44cc-ba37-e69359472e29 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117880) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:39:59.436997 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG dbcounter [-] [117880] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=117880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:39:59.447350 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.wsgi [None req-fa141f60-1414-44cc-ba37-e69359472e29 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] HTTP exception thrown: Instance 22a03003-3677-426e-8fb8-5b58998eef8a could not be found. Jul 18 10:39:59.449018 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-fa141f60-1414-44cc-ba37-e69359472e29 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Request method failure captured: Jul 18 10:39:59.449018 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: request: DELETE /compute/v2.1/servers/22a03003-3677-426e-8fb8-5b58998eef8a HTTP/1.1 Jul 18 10:39:59.449018 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: Accept: application/json Jul 18 10:39:59.449018 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: Accept-Encoding: identity Jul 18 10:39:59.449018 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: Connection: close Jul 18 10:39:59.449018 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: Content-Length: 0 Jul 18 10:39:59.449018 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: Content-Type: application/json Jul 18 10:39:59.449018 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: Host: 10.222.0.33 Jul 18 10:39:59.449018 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: Openstack-System-Scope: None Jul 18 10:39:59.449018 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: User-Agent: python-urllib3/1.26.9 Jul 18 10:39:59.449018 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Auth-Token: gAAAAABi1Ta7jUVddA4lAkYQOSn5ba4GUqIUnjCcEqF4pQxl-GEznssUVevgvZpkX6wQZnZIi_fUKggUhA3ggfdR-HT6czJuyYKZ7rf0YtZlULyLd1O6aYbOL68zIP4nma5o985FLbJEtPDh_LavK9gjeR0JtBZAYixbhp1H5pGtnwKvIXY--Bw Jul 18 10:39:59.449018 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Domain-Id: None Jul 18 10:39:59.449018 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Domain-Name: None Jul 18 10:39:59.449018 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Identity-Status: Confirmed Jul 18 10:39:59.449018 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Is-Admin-Project: True Jul 18 10:39:59.449018 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Project-Domain-Id: default Jul 18 10:39:59.449018 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Project-Domain-Name: Default Jul 18 10:39:59.449018 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Project-Id: 2c656b71bbd447cba7d11335c928dfda Jul 18 10:39:59.449018 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Project-Name: tempest-TestVolumeBootPattern-248550394 Jul 18 10:39:59.449018 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Role: member,reader Jul 18 10:39:59.449018 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Roles: member,reader Jul 18 10:39:59.450444 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/2c656b71bbd447cba7d11335c928dfda"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/2c656b71bbd447cba7d11335c928dfda"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/2c656b71bbd447cba7d11335c928dfda"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_2c656b71bbd447cba7d11335c928dfda"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jul 18 10:39:59.450444 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Tenant: tempest-TestVolumeBootPattern-248550394 Jul 18 10:39:59.450444 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Tenant-Id: 2c656b71bbd447cba7d11335c928dfda Jul 18 10:39:59.450444 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-Tenant-Name: tempest-TestVolumeBootPattern-248550394 Jul 18 10:39:59.450444 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-User: tempest-TestVolumeBootPattern-248550394-project Jul 18 10:39:59.450444 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-User-Domain-Id: default Jul 18 10:39:59.450444 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-User-Domain-Name: Default Jul 18 10:39:59.450444 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-User-Id: 4e9eb8d188e040bca894e038955f2402 Jul 18 10:39:59.450444 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: X-User-Name: tempest-TestVolumeBootPattern-248550394-project Jul 18 10:39:59.450444 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: method: > Jul 18 10:39:59.450444 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: exception: Instance 22a03003-3677-426e-8fb8-5b58998eef8a could not be found. Jul 18 10:39:59.450444 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: action_args: {'id': '22a03003-3677-426e-8fb8-5b58998eef8a'} Jul 18 10:39:59.451547 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 10:39:59.451547 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:39:59.451547 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 10:39:59.451547 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 10:39:59.451547 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 10:39:59.451547 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 10:39:59.451547 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 10:39:59.451547 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 10:39:59.451547 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 10:39:59.451547 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 10:39:59.451547 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 22a03003-3677-426e-8fb8-5b58998eef8a could not be found. Jul 18 10:39:59.451547 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi Jul 18 10:39:59.451547 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:39:59.451547 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi Jul 18 10:39:59.451547 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:39:59.451547 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:39:59.451547 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:39:59.451547 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 10:39:59.451547 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 10:39:59.451547 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 10:39:59.453546 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 10:39:59.453546 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 18 10:39:59.453546 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 18 10:39:59.453546 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 18 10:39:59.453546 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 18 10:39:59.453546 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 10:39:59.453546 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 10:39:59.453546 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 10:39:59.453546 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 10:39:59.453546 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 22a03003-3677-426e-8fb8-5b58998eef8a could not be found. Jul 18 10:39:59.453546 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi Jul 18 10:39:59.453546 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:39:59.453546 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi Jul 18 10:39:59.453546 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:39:59.453546 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:39:59.453546 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:39:59.453546 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 10:39:59.453546 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 10:39:59.453546 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 22a03003-3677-426e-8fb8-5b58998eef8a could not be found. Jul 18 10:39:59.453546 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: ERROR nova.api.openstack.wsgi Jul 18 10:39:59.455697 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-fa141f60-1414-44cc-ba37-e69359472e29 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Returning 404 to user: Instance 22a03003-3677-426e-8fb8-5b58998eef8a could not be found. {{(pid=117880) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 10:39:59.455697 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-fa141f60-1414-44cc-ba37-e69359472e29 tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] 10.222.0.33 "DELETE /compute/v2.1/servers/22a03003-3677-426e-8fb8-5b58998eef8a" status: 404 len: 111 microversion: 2.1 time: 0.030332 Jul 18 10:39:59.455697 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 548/1103] 10.222.0.33 () {58 vars in 1238 bytes} [Mon Jul 18 10:39:59 2022] DELETE /compute/v2.1/servers/22a03003-3677-426e-8fb8-5b58998eef8a => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 10:39:59.459587 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-8a0955d1-1cbf-414c-83a9-064be82f0b4d tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Calling method '>' {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:39:59.460335 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.compute.api [None req-8a0955d1-1cbf-414c-83a9-064be82f0b4d tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] [instance: 22a03003-3677-426e-8fb8-5b58998eef8a] Fetching instance by UUID {{(pid=117879) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:39:59.466339 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-8a0955d1-1cbf-414c-83a9-064be82f0b4d tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:39:59.466800 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-8a0955d1-1cbf-414c-83a9-064be82f0b4d tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:39:59.468124 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-8a0955d1-1cbf-414c-83a9-064be82f0b4d tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:39:59.468621 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG oslo_concurrency.lockutils [None req-8a0955d1-1cbf-414c-83a9-064be82f0b4d tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Lock "5fde33fe-e6c7-4fec-b6f1-087885458693" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117879) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:39:59.482630 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.wsgi [None req-8a0955d1-1cbf-414c-83a9-064be82f0b4d tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] HTTP exception thrown: Instance 22a03003-3677-426e-8fb8-5b58998eef8a could not be found. Jul 18 10:39:59.484364 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-8a0955d1-1cbf-414c-83a9-064be82f0b4d tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Request method failure captured: Jul 18 10:39:59.484364 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: request: GET /compute/v2.1/servers/22a03003-3677-426e-8fb8-5b58998eef8a HTTP/1.1 Jul 18 10:39:59.484364 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: Accept: application/json Jul 18 10:39:59.484364 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: Accept-Encoding: identity Jul 18 10:39:59.484364 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: Connection: close Jul 18 10:39:59.484364 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: Content-Length: 0 Jul 18 10:39:59.484364 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: Content-Type: application/json Jul 18 10:39:59.484364 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: Host: 10.222.0.33 Jul 18 10:39:59.484364 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: Openstack-System-Scope: None Jul 18 10:39:59.484364 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: User-Agent: python-urllib3/1.26.9 Jul 18 10:39:59.484364 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Auth-Token: gAAAAABi1Ta7jUVddA4lAkYQOSn5ba4GUqIUnjCcEqF4pQxl-GEznssUVevgvZpkX6wQZnZIi_fUKggUhA3ggfdR-HT6czJuyYKZ7rf0YtZlULyLd1O6aYbOL68zIP4nma5o985FLbJEtPDh_LavK9gjeR0JtBZAYixbhp1H5pGtnwKvIXY--Bw Jul 18 10:39:59.484364 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Domain-Id: None Jul 18 10:39:59.484364 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Domain-Name: None Jul 18 10:39:59.484364 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Identity-Status: Confirmed Jul 18 10:39:59.484364 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Is-Admin-Project: True Jul 18 10:39:59.484364 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Project-Domain-Id: default Jul 18 10:39:59.484364 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Project-Domain-Name: Default Jul 18 10:39:59.484364 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Project-Id: 2c656b71bbd447cba7d11335c928dfda Jul 18 10:39:59.484364 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Project-Name: tempest-TestVolumeBootPattern-248550394 Jul 18 10:39:59.484364 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Role: member,reader Jul 18 10:39:59.484364 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Roles: member,reader Jul 18 10:39:59.486079 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/2c656b71bbd447cba7d11335c928dfda"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/2c656b71bbd447cba7d11335c928dfda"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/2c656b71bbd447cba7d11335c928dfda"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_2c656b71bbd447cba7d11335c928dfda"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}] Jul 18 10:39:59.486079 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Tenant: tempest-TestVolumeBootPattern-248550394 Jul 18 10:39:59.486079 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Tenant-Id: 2c656b71bbd447cba7d11335c928dfda Jul 18 10:39:59.486079 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-Tenant-Name: tempest-TestVolumeBootPattern-248550394 Jul 18 10:39:59.486079 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-User: tempest-TestVolumeBootPattern-248550394-project Jul 18 10:39:59.486079 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-User-Domain-Id: default Jul 18 10:39:59.486079 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-User-Domain-Name: Default Jul 18 10:39:59.486079 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-User-Id: 4e9eb8d188e040bca894e038955f2402 Jul 18 10:39:59.486079 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: X-User-Name: tempest-TestVolumeBootPattern-248550394-project Jul 18 10:39:59.486079 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: method: > Jul 18 10:39:59.486079 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: exception: Instance 22a03003-3677-426e-8fb8-5b58998eef8a could not be found. Jul 18 10:39:59.486079 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: action_args: {'id': '22a03003-3677-426e-8fb8-5b58998eef8a'} Jul 18 10:39:59.486996 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: {{(pid=117879) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 10:39:59.486996 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:39:59.486996 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 10:39:59.486996 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 10:39:59.486996 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 10:39:59.486996 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 10:39:59.486996 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 10:39:59.486996 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 10:39:59.486996 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 10:39:59.486996 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 10:39:59.486996 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 22a03003-3677-426e-8fb8-5b58998eef8a could not be found. Jul 18 10:39:59.486996 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi Jul 18 10:39:59.486996 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:39:59.486996 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi Jul 18 10:39:59.486996 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:39:59.486996 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:39:59.486996 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:39:59.486996 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 10:39:59.486996 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 10:39:59.486996 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 10:39:59.488707 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 10:39:59.488707 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 10:39:59.488707 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 10:39:59.488707 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 10:39:59.488707 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 10:39:59.488707 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 10:39:59.488707 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 10:39:59.488707 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 22a03003-3677-426e-8fb8-5b58998eef8a could not be found. Jul 18 10:39:59.488707 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi Jul 18 10:39:59.488707 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:39:59.488707 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi Jul 18 10:39:59.488707 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:39:59.488707 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:39:59.488707 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:39:59.488707 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 10:39:59.488707 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 10:39:59.488707 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 22a03003-3677-426e-8fb8-5b58998eef8a could not be found. Jul 18 10:39:59.488707 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: ERROR nova.api.openstack.wsgi Jul 18 10:39:59.490139 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: DEBUG nova.api.openstack.wsgi [None req-8a0955d1-1cbf-414c-83a9-064be82f0b4d tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Returning 404 to user: Instance 22a03003-3677-426e-8fb8-5b58998eef8a could not be found. {{(pid=117879) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 10:39:59.490139 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO nova.api.openstack.requestlog [None req-8a0955d1-1cbf-414c-83a9-064be82f0b4d tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] 10.222.0.33 "GET /compute/v2.1/servers/22a03003-3677-426e-8fb8-5b58998eef8a" status: 404 len: 111 microversion: 2.1 time: 0.030029 Jul 18 10:39:59.490139 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: [pid: 117879|app: 0|req: 556/1104] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jul 18 10:39:59 2022] GET /compute/v2.1/servers/22a03003-3677-426e-8fb8-5b58998eef8a => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 10:40:00.786433 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: DEBUG nova.api.openstack.wsgi [None req-9b96cb66-41f3-42db-b7ae-ba18a17c966c tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] Calling method '.version_select at 0x7f9f4a3db700>' {{(pid=117880) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:40:00.807370 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO nova.api.openstack.requestlog [None req-9b96cb66-41f3-42db-b7ae-ba18a17c966c tempest-TestVolumeBootPattern-248550394 tempest-TestVolumeBootPattern-248550394-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-986614198" status: 202 len: 0 microversion: 2.1 time: 0.024689 Jul 18 10:40:00.808227 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: [pid: 117880|app: 0|req: 549/1105] 10.222.0.33 () {58 vars in 1259 bytes} [Mon Jul 18 10:40:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-986614198 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 10:40:47.022766 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 10:40:47.023414 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: Mon Jul 18 10:40:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 18 10:42:21.330542 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 10:42:21.331113 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: Mon Jul 18 10:42:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 18 10:42:35.523206 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 10:42:35.523734 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: Mon Jul 18 10:42:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 18 10:42:45.012404 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 10:42:45.013121 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: Mon Jul 18 10:42:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 18 10:42:47.819490 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 10:42:47.820059 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: Mon Jul 18 10:42:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 18 10:44:07.032206 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 10:44:07.033151 dv-cinder-837546-3-iscsi devstack@n-api.service[117879]: Mon Jul 18 10:44:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 18 10:44:10.296103 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 10:44:10.297520 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: Mon Jul 18 10:44:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 18 10:45:41.339059 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 10:45:41.340071 dv-cinder-837546-3-iscsi devstack@n-api.service[117880]: Mon Jul 18 10:45:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!